-- Logs begin at Wed 2022-06-08 12:46:31 UTC, end at Wed 2022-06-08 14:12:16 UTC. -- Jun 08 13:37:35.802628 dv-cinder-819149-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 08 13:37:35.811846 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 8 13:37:35 2022] *** Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: nodename: dv-cinder-819149-5-iscsi Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: machine: x86_64 Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: clock source: unix Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: pcre jit disabled Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: detected number of CPU cores: 4 Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: current working directory: / Jun 08 13:37:35.813860 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: detected binary path: /usr/bin/uwsgi-core Jun 08 13:37:35.814570 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: your processes number limit is 47680 Jun 08 13:37:35.814570 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: your memory page size is 4096 bytes Jun 08 13:37:35.814570 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: detected max file descriptor number: 2048 Jun 08 13:37:35.814570 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: lock engine: pthread robust mutexes Jun 08 13:37:35.814570 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: thunder lock: enabled Jun 08 13:37:35.814570 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 08 13:37:35.814570 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 08 13:37:35.859538 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: Python main interpreter initialized at 0x55941deec9c0 Jun 08 13:37:35.859538 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: python threads support enabled Jun 08 13:37:35.859538 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: your server socket listen backlog is limited to 100 connections Jun 08 13:37:35.859538 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: your mercy for graceful operations on workers is 90 seconds Jun 08 13:37:35.859861 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: mapped 403077 bytes (393 KB) for 2 cores Jun 08 13:37:35.859946 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: *** Operational MODE: preforking *** Jun 08 13:37:35.860209 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: *** uWSGI is running in multiple interpreter mode *** Jun 08 13:37:35.860209 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: spawned uWSGI master process (pid: 110221) Jun 08 13:37:35.860397 dv-cinder-819149-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 08 13:37:35.860959 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: spawned uWSGI worker 1 (pid: 110222, cores: 1) Jun 08 13:37:35.861297 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: spawned uWSGI worker 2 (pid: 110223, cores: 1) Jun 08 13:37:35.861456 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 08 13:37:37.102653 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 08 13:37:37.106903 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 08 13:37:37.829660 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:37:37.829660 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: from cryptography.utils import int_from_bytes Jun 08 13:37:37.829986 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:37:37.829986 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: from cryptography.utils import int_from_bytes Jun 08 13:37:37.833583 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:37:37.833583 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: from cryptography.utils import int_from_bytes Jun 08 13:37:37.833925 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:37:37.833925 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: from cryptography.utils import int_from_bytes Jun 08 13:37:40.412333 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 13:37:40.412867 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 13:37:40.413024 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 13:37:40.413382 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 13:37:40.413639 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 13:37:40.414024 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.414346 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.414665 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.414982 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.415312 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.415616 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.415717 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 13:37:40.416120 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.416294 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 13:37:40.416388 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.416521 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 13:37:40.416610 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.416820 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.416905 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 13:37:40.417131 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 13:37:40.417217 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.417455 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-5-iscsi {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.417563 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.417773 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.417882 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.418075 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.418172 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.418381 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.418478 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.418700 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.418806 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.419001 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.419096 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.419315 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.419412 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.419618 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.419728 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.420024 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.420145 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.420316 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.420666 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.421195 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.421270 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.421336 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-5-iscsi {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.421411 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.421478 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.421543 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.421793 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.421898 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.422097 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.422184 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.422415 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.422513 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.422719 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.422821 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.423037 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.423131 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.423340 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.423443 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.423728 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-5-iscsi {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.423848 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.424066 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.424199 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.424399 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.424533 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.424682 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.424800 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.425090 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.425179 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.425397 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.425486 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.425699 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.425790 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.426016 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.426110 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.426334 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.426421 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.426637 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.426725 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.426960 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.427062 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.427271 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.427366 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-5-iscsi {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.427585 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.427674 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.427898 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.427997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.428223 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.428320 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.428526 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.428693 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.428833 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.429010 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.429146 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.429324 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.429446 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.429649 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.429737 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.429976 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.430076 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.430275 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.430367 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.430591 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.430678 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.430906 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.430994 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.431221 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.431320 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.431471 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.431571 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.431717 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.431841 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.432029 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.432179 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.432363 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.432490 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.432666 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.432812 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.432967 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.433123 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.433267 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.433436 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.433567 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.433690 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.433866 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.433999 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.434170 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.434348 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.434451 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.434650 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.434753 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.434974 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.435088 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.435233 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.435359 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.435504 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.435657 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.435794 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.435956 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.436790 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.437282 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.437390 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.437474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.437562 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.437651 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.437900 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.437992 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.438216 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.438311 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.438529 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.438628 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.438841 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.438938 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.439155 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.439241 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.439465 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.439553 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.439769 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.439878 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.440086 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.440201 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.440392 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.440480 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.440708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.440795 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.441028 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.441125 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.441328 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.441424 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.441577 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.441720 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.441872 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.441970 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.442171 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.442299 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.442486 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.442622 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.442788 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.442966 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.443089 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.443244 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.443388 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.443567 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.443686 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.443884 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.443973 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.444235 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.444385 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.444532 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.444630 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.444857 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.444954 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.445167 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.445265 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.445469 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.445594 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.445729 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.445831 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.446031 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.446124 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.446340 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.446442 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.446652 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.446742 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.446960 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.447051 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.447260 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.447351 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.447559 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.447650 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.447859 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.447961 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.448184 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.448290 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.448499 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.448590 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.448800 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.448901 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.449100 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.449192 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.449420 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.449512 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.449720 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.449811 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.450020 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.450120 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.450325 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.450415 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.450626 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.450716 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.450927 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.451027 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.451242 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.451334 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.451538 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.451629 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.452451 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.452936 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.453028 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.453119 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.453215 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.453297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.453384 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.453551 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.453643 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.453868 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.453956 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.454179 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.454279 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.454494 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.454583 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.454794 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.454882 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.455094 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.455192 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.455392 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.455483 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.455706 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.455813 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.456019 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.456144 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.456345 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.456434 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.456647 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.456735 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.456949 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.457046 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.457264 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.457352 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.457572 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.457658 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.457883 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.457972 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.458189 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.458286 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.458498 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.458594 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.458805 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.458894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.459114 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.459202 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.459444 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.459546 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.459752 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.459840 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.460088 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.460180 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.460401 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.460501 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.460708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.460794 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.461016 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.461102 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.461324 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.461421 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.461630 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.461716 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.461940 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.462025 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:37:40.462266 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.462354 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.462578 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.462674 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.462890 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.462986 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.463467 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.463570 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.463782 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.463869 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.464118 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.464210 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.464442 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.464573 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.464759 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.464930 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.465064 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.465152 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.465397 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.465493 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.465723 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.465848 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.466035 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.466138 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.466355 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.466482 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.466673 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.466773 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.466979 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.467071 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.467333 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.467424 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.467656 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.467878 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.468108 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.468418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.468511 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.468736 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.468930 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.469081 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.469388 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.469494 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.469714 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.469843 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.470029 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.470160 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.470371 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.470472 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.470717 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.470806 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.471033 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.471123 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.471360 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.471458 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.471701 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.471839 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.472016 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.472127 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.472354 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.472445 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.472667 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.472753 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.472984 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.473072 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.473295 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.473384 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.473604 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.473691 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.473913 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.474009 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.474217 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.474306 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.474522 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.474617 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.474827 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.474914 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.475136 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.475225 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.475437 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.475586 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.475838 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.475929 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.476095 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.476189 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.476391 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.476479 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.476722 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.476829 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.477029 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.477119 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.477338 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.477425 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.477645 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.477746 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.477951 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.478039 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.478255 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.478354 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.478561 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.478658 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.478868 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.478955 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.479175 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.479264 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.479480 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.479575 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.479797 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.479884 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.480131 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.480223 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.480445 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.480533 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.480748 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.480843 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.481054 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.481156 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.481368 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.481457 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.481678 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.481764 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.481986 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.482080 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.482292 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.482380 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.482599 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.482686 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.482946 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.483103 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.483243 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.483405 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.483556 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.483892 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.484000 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.484231 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.484330 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.484536 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.484631 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.484858 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.484953 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.485166 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.485254 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.485477 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.485569 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.485780 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.485871 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.486090 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.486179 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.486393 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.486481 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.486696 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.486783 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.486999 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.487088 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.487303 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.487391 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.487605 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.487703 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.487907 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.487995 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.488232 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.488322 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.488535 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.488636 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.488839 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.488927 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.489157 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.489245 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.489466 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.489568 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.489768 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.489856 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.490069 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.490156 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.490369 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.490467 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.490709 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.490797 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.491011 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.491099 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.491324 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.491412 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.491637 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.491725 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.491944 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.492033 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.492283 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.492374 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.492591 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.492679 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.492966 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.493121 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.493216 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.493297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.493502 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.493589 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.493809 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.493897 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.494116 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.494207 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.494421 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.494507 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.494726 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.494828 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.495042 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.495140 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.495348 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.495437 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.495668 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.495803 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.495973 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.496100 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.496315 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.496403 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.496618 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.496718 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.496926 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.497013 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.497261 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.497349 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.497589 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.497686 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.497899 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.497986 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.498212 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.498308 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.499046 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.499273 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.499398 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.499497 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.499692 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.499823 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.500017 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.500161 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.500357 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.500445 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.500687 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.500774 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.501002 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.501091 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.501324 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.501420 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.501634 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.501722 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.501946 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.502040 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.502266 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.502354 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.502572 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.502728 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.502889 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.502977 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.503193 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.503283 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.503506 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.503602 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.503831 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.503919 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.504176 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.504265 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.504486 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.504586 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.504795 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.504882 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.505109 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.505194 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.505417 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.505512 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.505725 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.505813 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.506033 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.506128 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.506338 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.506440 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.506641 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.506727 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.506946 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.507032 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.507260 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.507348 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.507568 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.507655 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.507874 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.507969 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.508199 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.508289 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.508511 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.508600 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.508817 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.508904 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.509118 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.509205 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.509424 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.509510 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.509732 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.509819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.510052 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.510139 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.510359 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.510445 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.510676 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.510771 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.510993 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.511089 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.511292 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.511379 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.511593 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.511689 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.511911 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.511998 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.512241 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.512330 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.512545 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.512641 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.512848 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.512936 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.513149 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.513242 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.513462 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.513561 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.513770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.513858 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.514071 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.514215 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.514993 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.515141 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.515313 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.515473 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.515640 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.515729 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.515967 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.516085 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.516301 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.516403 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.516612 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.516700 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.516937 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.517024 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.517247 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.517340 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.517552 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.517647 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.517861 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.517956 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.518168 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.518255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.518477 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.518564 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.518785 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.518873 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.519105 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.519192 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.519414 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.519518 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.519727 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.519823 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.520033 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.520204 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.520355 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.520456 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.520664 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.520752 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.520976 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.521063 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.521302 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.521546 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.521653 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.521877 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.521964 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.522190 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.522277 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.522505 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.522593 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.522815 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.522900 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.523132 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.523227 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.523462 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.523548 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.523773 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.523862 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.524129 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.524301 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.524437 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.524533 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.524743 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.524837 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.525048 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.525135 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.525353 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.525442 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.525661 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.525923 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.526012 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.526254 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.526348 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.526555 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.526642 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.526861 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.526947 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.527163 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.527270 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.527464 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.527559 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.527763 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.527858 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.528093 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.528203 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.528402 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.528523 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.528703 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.528840 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.529010 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.529158 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.529313 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.529469 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.529638 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.529825 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.529985 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.530146 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.530242 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.530448 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.530540 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.530758 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.530847 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.531070 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.531158 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.531386 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.531473 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.531697 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.531793 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.532007 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.532115 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.532338 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.532439 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.532649 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.532745 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.532970 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.533059 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.533280 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.533410 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.533597 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.533699 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.533898 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.533986 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.534201 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.534295 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.534508 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.534604 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.534814 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.534902 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.535116 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.535211 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.535423 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.535519 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.535730 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.535825 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.536037 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.536222 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.536365 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.536467 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.536667 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.536756 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.536974 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.537071 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.537276 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.537363 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.537585 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.537680 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.537890 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.537977 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.538190 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.538279 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.538491 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.538578 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.538796 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.538891 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.539101 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.539190 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.539405 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.539493 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.539711 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.539815 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.540011 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.540118 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.540348 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.540446 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.540650 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.540747 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.540952 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.541039 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.541254 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.541340 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.541560 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.541657 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.541867 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.541953 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.542167 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.542254 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.542486 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.542581 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.542792 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.542878 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.543094 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.543181 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.543397 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.543531 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.543702 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.543798 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.544001 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.544134 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.544327 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.544425 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.544633 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.544719 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.544951 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.545045 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.545258 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.545345 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.546086 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.546176 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.546417 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.546504 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.546717 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.546804 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.547018 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.547106 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.547320 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.547417 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.547625 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.547718 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.547926 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.548013 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.548249 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.548420 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.548550 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.548637 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.548849 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.548936 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.549151 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.549247 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.549456 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.549550 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.549767 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.549854 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.550068 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.550164 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.550367 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.550462 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.550666 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.550762 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.550988 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.551076 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.551291 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.551378 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.551613 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.551699 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.551923 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.552019 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.552259 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.552346 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.552565 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.552663 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.552871 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.552958 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.553175 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.553269 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.553482 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.553610 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.553783 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.553872 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.554092 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.554179 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.554396 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.554490 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.554703 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.554791 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.555000 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.555095 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.555297 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.555394 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.555614 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.555711 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.555921 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.556009 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.556249 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.556356 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.556566 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.556662 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.556884 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.556973 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.557202 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.557297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.557502 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.557597 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.557806 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.557894 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.558111 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.558207 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.558415 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.558510 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.558721 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.558820 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.559025 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.559121 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.559336 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.559433 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.559641 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.559735 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.559947 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.560034 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.560281 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.560369 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.560589 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.560684 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.560892 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.560987 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.561829 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.561927 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.562211 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.562302 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.562514 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.562602 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.562837 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.562924 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.563144 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.563240 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.563447 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.563542 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.563752 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.563839 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.564099 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.564203 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.564378 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.564474 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.564680 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.564775 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.565035 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.565130 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.565351 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.565445 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.565666 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.565753 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.565977 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.566072 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.566285 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.566372 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.566590 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.566675 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.566901 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.566988 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.567207 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.567293 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.567507 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.567603 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.567831 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.567918 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.568164 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.568255 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.568478 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.568566 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.568783 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.568880 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.569112 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.569198 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.569418 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.569506 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.569720 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.569844 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.570037 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.570157 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.570336 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.570469 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.570635 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.570775 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.570934 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.571086 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.571252 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.571397 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.571553 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.571713 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.571869 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.572029 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.572302 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.572403 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.572610 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.572764 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.572912 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.573079 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.573325 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.573421 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.573635 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.573722 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.573942 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.574027 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.574261 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.574355 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.574578 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.574927 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.575025 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.575108 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.575198 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.575280 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.575482 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.575578 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.575787 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.575876 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.576131 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.576222 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.576440 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.576539 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.576832 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.576934 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.577169 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.577495 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.577590 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.577821 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.577936 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.578139 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.578232 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.578500 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.578596 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.578822 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.578910 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.579168 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.579254 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.579495 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.579585 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.579823 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.579911 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.580180 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.580269 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.580492 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.580589 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.580794 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.580888 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.581098 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.581195 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.581404 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.581493 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.581704 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.581792 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.582008 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.582096 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.582325 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.582414 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.582627 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.582722 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.582934 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.583036 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.583240 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.583328 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.583544 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.583643 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.583845 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.583941 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.584169 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.584312 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.584490 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.584642 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.584790 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.584958 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.585107 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.585284 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.585417 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.585615 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.585735 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.585926 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.586049 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.586235 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.586353 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.586567 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.586669 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.586877 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.586965 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.587185 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.587273 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.587510 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.587607 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.587817 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.587906 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.588156 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.588509 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.588726 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.588868 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.589036 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.589133 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.589343 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.589441 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.589648 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.589744 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.589972 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.590058 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.590274 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.590360 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.590598 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.590694 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.590912 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.591042 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.591227 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.591315 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.591548 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.591636 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.591849 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.591935 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.592176 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.592284 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.592526 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.592616 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.592897 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.592998 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.593159 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.593237 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.593467 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.593564 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.593771 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.593858 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.594072 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.594173 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.594374 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.594462 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.594676 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.594765 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.594995 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.595091 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.595298 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.595385 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.595617 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.595704 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.595924 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.596137 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.596250 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.596338 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.596552 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.596649 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.596854 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.596952 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.597192 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.597329 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.597494 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.597583 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.597826 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.597915 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.598137 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.598223 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.598443 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.598532 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.598751 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.598849 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.599061 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.599149 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.599364 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.599467 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.599670 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.599760 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.599975 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.600083 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.600313 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.600399 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.600619 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.600707 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.600931 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.601025 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.601241 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.601343 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.601547 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.601636 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.601851 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.601938 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.602156 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.602251 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.602466 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.602553 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.602779 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.602866 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.603114 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.603297 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.603434 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.603619 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.603774 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.603930 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.604107 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.604265 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.604444 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.604572 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.604772 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.604870 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.605092 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.605183 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.605411 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.605506 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.605729 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.605818 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.606045 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.606141 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.606348 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.606436 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.606665 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.606750 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.606981 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.607068 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.607291 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.607377 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.607608 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.607704 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.608456 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.608557 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.608773 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.609029 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.609118 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.609391 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.609588 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.609740 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.609925 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.610049 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.610246 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.610346 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.610567 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.610664 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.610886 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.610974 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.611206 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.611302 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.611526 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.611621 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.611833 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.611928 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.612166 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.612258 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.612477 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.612565 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.612786 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.612873 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.613091 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.613180 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.613399 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.613486 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.613708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.613804 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.614027 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.614123 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.614357 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.614448 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.614672 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.614769 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.614981 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.615069 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.615291 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.615378 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.615601 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.615698 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.615976 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.616136 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.616313 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.616447 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.616634 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.616775 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.616956 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.617097 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.617275 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.617418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.617590 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.617731 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.617906 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.618044 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.618225 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.618367 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.618531 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.618672 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.618843 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.618974 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.619158 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.619286 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.619474 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.619590 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.619792 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.619888 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.620148 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.620253 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.620492 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.620628 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.620801 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.620888 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.621114 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.621211 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.621420 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.621507 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.621741 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.621951 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.622269 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.622359 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.622592 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.622688 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.622912 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.623007 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.623236 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.623325 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.624142 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.624255 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.624480 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.624557 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.624839 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.624981 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.625146 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.625321 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.625450 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.625638 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.625762 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.625954 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.626070 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.626293 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.626381 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.626611 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.626700 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.626923 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.627011 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.627250 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.627340 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.627551 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.627640 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.627857 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.627944 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.628182 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.628274 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.628507 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.628596 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.628812 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.629053 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.629141 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.629407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.629509 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.629712 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.629798 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.630012 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.630099 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.630314 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.630404 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.630616 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.630703 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.630917 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.631004 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.631224 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.631313 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.631526 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.631621 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.631829 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.631918 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.632158 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.632249 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.632468 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.632567 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.632770 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.632865 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.633075 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.633164 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.633426 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.633515 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.633746 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.633842 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.634047 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.634142 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.634348 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.634442 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.634660 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.634761 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.634966 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.635063 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.635283 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.635372 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.635592 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.635694 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.635897 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.635992 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.636236 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.636325 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.636549 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.636649 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.636859 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.637091 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.637179 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.637426 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.637523 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.637747 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.637838 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.638077 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.638164 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.638389 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.638485 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.638702 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.638798 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.639009 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.639098 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.639351 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.639448 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.639700 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.639826 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.640108 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.640212 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.640420 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.640519 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.640730 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.640819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.641039 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.641126 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.641348 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.641437 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.641655 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.641742 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.641961 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.642048 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.642268 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.642357 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.642574 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.642663 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.642879 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.642975 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.643186 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.643276 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.643493 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.643798 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.643892 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.644165 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.644255 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.644496 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.644594 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.644832 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.644929 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.645145 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.645234 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.645456 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.645551 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.645771 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.645858 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.646077 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.646165 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.646384 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.646471 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.646691 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.646778 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.646998 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.647097 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.647309 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.647396 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.647624 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.647797 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.647934 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.648022 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.648264 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.648354 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.648578 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.648742 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.648892 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.648989 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.649231 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.649320 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.649546 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.649647 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.649858 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.649949 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.650172 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.650262 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.650484 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.650573 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.650787 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.650873 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.651102 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.651201 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.651409 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.651497 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.651732 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.651828 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.652064 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.652155 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.652395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.652486 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.652711 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.652800 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.653014 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.653114 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.653319 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.653415 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.653620 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.653709 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.653926 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.654022 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.654240 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.654328 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.654547 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.654643 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.654887 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.654991 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.655281 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.655415 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.655588 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.655677 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.655890 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.655979 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.656215 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.656317 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.656520 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.656610 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.656824 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.656913 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.657129 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.657217 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.657429 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.657516 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.657729 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.657858 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.658028 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.658124 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.658327 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.658437 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.658626 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.658777 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.658930 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.659109 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.659235 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.659437 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.659526 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.659745 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.659833 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.660092 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.660185 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.660386 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.660476 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.660698 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.660786 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.661022 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.661116 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.661343 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.661431 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.661650 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.661738 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.661958 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.662054 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.662262 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.662567 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.662657 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.662871 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.662967 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.663176 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.663264 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.663484 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.663580 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.663792 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.663894 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.664120 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.664224 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.664434 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.664522 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.664740 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.664841 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.665045 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.665133 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.665350 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.665437 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.665653 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.665741 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.665956 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.666045 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.666258 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.666344 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.666566 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.666655 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.666870 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.666966 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.667172 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.667260 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.667476 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.667564 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.667793 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.667881 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.668131 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.668221 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.668443 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.668539 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.668750 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.668839 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.669079 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.669178 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.669387 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.669475 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.669692 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.669779 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.670003 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.670098 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.670307 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.670916 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.671133 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.671294 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.671445 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.671710 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.671800 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.672085 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.672187 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.672411 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.672507 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.672715 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.672802 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.673037 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.673124 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.673353 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.673448 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.673672 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.674193 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.674335 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.674451 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.674536 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.674631 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.674631 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.674779 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.674921 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.675053 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.675227 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.675326 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.675528 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.675625 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.675769 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 13:37:40.675858 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.676223 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.676545 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.676881 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.677196 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.677533 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.677855 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.678170 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.678485 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.678805 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.679125 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.679458 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.679787 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.680126 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.680460 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.680791 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.681140 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.681460 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.681801 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.682130 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.682448 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.682764 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.683074 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:37:40.683320 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 13:37:40.734820 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO dbcounter [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Registered counter for database nova_api Jun 08 13:37:40.743202 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO dbcounter [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Registered counter for database nova_api Jun 08 13:37:40.755424 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_db.sqlalchemy.engines [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:37:40.761991 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writer thread running {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:37:40.763682 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG oslo_db.sqlalchemy.engines [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:37:40.770757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writer thread running {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:37:40.818635 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.context [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e34c71c5-8d83-411d-9d43-2dd085938513(cell1) {{(pid=110222) load_cells /opt/stack/nova/nova/context.py:464}} Jun 08 13:37:40.822724 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:37:40.824316 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:37:40.825087 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:37:40.827819 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:37:40.828164 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.context [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e34c71c5-8d83-411d-9d43-2dd085938513(cell1) {{(pid=110223) load_cells /opt/stack/nova/nova/context.py:464}} Jun 08 13:37:40.829777 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO dbcounter [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Registered counter for database nova_cell0 Jun 08 13:37:40.832266 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:37:40.833688 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO dbcounter [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Registered counter for database nova_cell1 Jun 08 13:37:40.833836 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:37:40.834621 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:37:40.836714 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG oslo_concurrency.lockutils [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110223) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:37:40.838957 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO dbcounter [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Registered counter for database nova_cell0 Jun 08 13:37:40.843898 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_db.sqlalchemy.engines [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:37:40.844085 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO dbcounter [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Registered counter for database nova_cell1 Jun 08 13:37:40.845075 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_db.sqlalchemy.engines [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:37:40.851080 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG oslo_db.sqlalchemy.engines [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:37:40.851528 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writer thread running {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:37:40.852843 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writer thread running {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:37:40.853320 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG oslo_db.sqlalchemy.engines [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:37:40.860825 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writer thread running {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:37:40.862113 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writer thread running {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:37:40.999230 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO dbcounter [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Registered counter for database nova_cell0 Jun 08 13:37:41.007761 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_db.sqlalchemy.engines [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:37:41.010559 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO dbcounter [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Registered counter for database nova_cell0 Jun 08 13:37:41.012045 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writer thread running {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:37:41.019480 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG oslo_db.sqlalchemy.engines [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:37:41.023871 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writer thread running {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:37:41.553645 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: WARNING keystonemiddleware.auth_token [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 13:37:41.560933 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: WARNING keystonemiddleware.auth_token [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 13:37:41.591994 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: WARNING keystonemiddleware.auth_token [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 13:37:41.599537 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: WARNING keystonemiddleware.auth_token [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 13:37:41.782016 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: WARNING keystonemiddleware.auth_token [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 13:37:41.788027 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: WARNING keystonemiddleware.auth_token [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 13:37:41.793208 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55941deec9c0 pid: 110222 (default app) Jun 08 13:37:41.796844 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:37:41.798047 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003265 Jun 08 13:37:41.798459 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Wed Jun 8 13:37:41 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:37:41.826832 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: WARNING keystonemiddleware.auth_token [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 13:37:41.836198 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: WARNING keystonemiddleware.auth_token [None req-38ed7a50-20bc-4968-960d-7460a4a956e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 13:37:41.837997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55941deec9c0 pid: 110223 (default app) Jun 08 13:39:03.875255 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:03.876319 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 08 13:39:03.876712 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:03.890792 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_api:SELECT=3 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:03.892000 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_cell1:SELECT=3 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:03.892986 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_cell0:SELECT=3 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:03.893928 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:04.332772 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-4037c92e-ed03-437d-82e7-a752f0cb0013 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:04.365019 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-4037c92e-ed03-437d-82e7-a752f0cb0013 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479983 Jun 08 13:39:04.366443 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 8 13:39:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:39:06.693802 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:06.694815 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-f9eb034c-0849-4a9f-8e83-c1f14c8bb09d None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 08 13:39:06.696361 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 3/4] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:06.761082 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-161fd195-4c5d-4585-89f7-e5d28e3f370a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:06.780254 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:39:06.780254 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: warnings.warn(msg) Jun 08 13:39:06.884164 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-161fd195-4c5d-4585-89f7-e5d28e3f370a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.182014 Jun 08 13:39:06.884932 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 2/5] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:39:06.899256 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_api:SELECT=3 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:06.900965 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_cell1:SELECT=3 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:06.901109 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_cell0:SELECT=3 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:06.902060 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:07.109923 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fbeb89bf-6f2f-4007-96d9-37dcf36e15bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:07.112604 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:39:07.112604 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: warnings.warn(msg) Jun 08 13:39:07.252668 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-fbeb89bf-6f2f-4007-96d9-37dcf36e15bc admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.359067 Jun 08 13:39:07.263358 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 4/6] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 8 13:39:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:39:09.590801 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-161fd195-4c5d-4585-89f7-e5d28e3f370a admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:09.591818 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-161fd195-4c5d-4585-89f7-e5d28e3f370a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 08 13:39:09.592269 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 3/7] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:09.706824 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-138c2f58-65ec-4787-9c3d-c0fd24aec988 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:09.725379 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:39:09.725379 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: warnings.warn(msg) Jun 08 13:39:09.824209 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-138c2f58-65ec-4787-9c3d-c0fd24aec988 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.226210 Jun 08 13:39:09.825251 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 5/8] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 13:39:09.842166 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-51e73413-0271-4ce1-b68c-e76ba9ccfe3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:09.843729 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:39:09.843729 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: warnings.warn(msg) Jun 08 13:39:09.953701 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-51e73413-0271-4ce1-b68c-e76ba9ccfe3d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117273 Jun 08 13:39:09.955484 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 4/9] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 8 13:39:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:39:12.296441 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-138c2f58-65ec-4787-9c3d-c0fd24aec988 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:12.297448 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-138c2f58-65ec-4787-9c3d-c0fd24aec988 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jun 08 13:39:12.297849 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:12.358284 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-f1e7f555-6725-4d76-b501-1ec3b8cc0ccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:12.418568 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-f1e7f555-6725-4d76-b501-1ec3b8cc0ccf admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.114331 Jun 08 13:39:12.419218 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 5/11] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:39:12.431804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-41cc84a4-759c-49b3-a994-fa9c8019c6b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:12.506861 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-41cc84a4-759c-49b3-a994-fa9c8019c6b1 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079073 Jun 08 13:39:12.507597 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 7/12] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 8 13:39:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:39:14.820822 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-f1e7f555-6725-4d76-b501-1ec3b8cc0ccf admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:14.821860 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-f1e7f555-6725-4d76-b501-1ec3b8cc0ccf admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jun 08 13:39:14.822710 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 6/13] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:14.885597 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fdf1a1a1-44bc-4289-8937-234a3d97cf94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:14.949164 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-fdf1a1a1-44bc-4289-8937-234a3d97cf94 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.119988 Jun 08 13:39:14.949709 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 8/14] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:39:14.961856 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-4d300bad-a187-46ca-ad24-13e28fcde871 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:15.038038 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-4d300bad-a187-46ca-ad24-13e28fcde871 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079830 Jun 08 13:39:15.038560 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 7/15] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 8 13:39:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:39:17.361904 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fdf1a1a1-44bc-4289-8937-234a3d97cf94 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:17.362828 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-fdf1a1a1-44bc-4289-8937-234a3d97cf94 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 08 13:39:17.363225 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 9/16] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:17.422371 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-cfb18f08-e056-46c1-a677-024691a2ba35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:17.519845 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-cfb18f08-e056-46c1-a677-024691a2ba35 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150867 Jun 08 13:39:17.520621 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 8/17] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 13:39:17.532671 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-a23c7c9c-9c3b-4c5b-b15c-270124bab1af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:17.597255 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-a23c7c9c-9c3b-4c5b-b15c-270124bab1af admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068257 Jun 08 13:39:17.597871 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 10/18] 10.222.0.55 () {64 vars in 1335 bytes} [Wed Jun 8 13:39:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:39:19.946448 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-cfb18f08-e056-46c1-a677-024691a2ba35 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:19.947454 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-cfb18f08-e056-46c1-a677-024691a2ba35 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 08 13:39:19.948068 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 9/19] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:20.007752 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-6af77408-4601-4871-bf66-4d3b9c719c3a admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:20.031547 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-6af77408-4601-4871-bf66-4d3b9c719c3a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077368 Jun 08 13:39:20.032427 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 8 13:39:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:39:22.380209 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-cfb18f08-e056-46c1-a677-024691a2ba35 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:22.381255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-cfb18f08-e056-46c1-a677-024691a2ba35 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jun 08 13:39:22.381819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 10/21] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:22.450719 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-e1926cf4-0689-4c31-aafa-849b17e64fe0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:22.525175 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-e1926cf4-0689-4c31-aafa-849b17e64fe0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.136873 Jun 08 13:39:22.525865 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 12/22] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:39:22.542356 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-06ebfb61-eb7f-4a14-9e0f-ba906d623b56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:22.615029 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-06ebfb61-eb7f-4a14-9e0f-ba906d623b56 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076837 Jun 08 13:39:22.615458 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 11/23] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 8 13:39:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:39:25.864188 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-e1926cf4-0689-4c31-aafa-849b17e64fe0 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:25.865231 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-e1926cf4-0689-4c31-aafa-849b17e64fe0 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jun 08 13:39:25.865654 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:25.938802 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-77daeb05-e8a0-4ddf-81c4-16e729371e67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "ram": 2048, "id": "2", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:26.046547 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-77daeb05-e8a0-4ddf-81c4-16e729371e67 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.174649 Jun 08 13:39:26.046967 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 12/25] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:39:26.063337 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-2df1837c-7b0e-4806-bf77-bcaf5703663a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:26.148518 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-2df1837c-7b0e-4806-bf77-bcaf5703663a admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093218 Jun 08 13:39:26.149426 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 14/26] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 8 13:39:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:39:28.507408 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-77daeb05-e8a0-4ddf-81c4-16e729371e67 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:28.508471 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-77daeb05-e8a0-4ddf-81c4-16e729371e67 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 08 13:39:28.508874 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:28.567652 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-84434470-868b-4f7d-bb86-9c9a0c112dce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "id": "3", "swap": 0}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:28.640895 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-84434470-868b-4f7d-bb86-9c9a0c112dce admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.125705 Jun 08 13:39:28.641460 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 15/28] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:39:28.654302 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-301c4349-2266-42ea-9e39-6a9156eb37e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:28.741231 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-301c4349-2266-42ea-9e39-6a9156eb37e5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091247 Jun 08 13:39:28.741774 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 14/29] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 8 13:39:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:39:31.056686 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-84434470-868b-4f7d-bb86-9c9a0c112dce admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:31.059337 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-84434470-868b-4f7d-bb86-9c9a0c112dce admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003229 Jun 08 13:39:31.059983 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:31.142891 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-8ca6c49a-10db-4264-ab22-9076a9601699 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "ram": 8192}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:31.207039 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-8ca6c49a-10db-4264-ab22-9076a9601699 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.140277 Jun 08 13:39:31.208355 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 15/31] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:39:31.220394 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-274c6b87-8d5f-4cf5-a428-3198d7576e01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:31.301554 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-274c6b87-8d5f-4cf5-a428-3198d7576e01 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084651 Jun 08 13:39:31.302646 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 17/32] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 8 13:39:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:39:33.696519 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-8ca6c49a-10db-4264-ab22-9076a9601699 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:33.697516 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-8ca6c49a-10db-4264-ab22-9076a9601699 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 08 13:39:33.698778 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 16/33] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:33.761281 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-882fa945-7f66-49af-9d66-bdc204235b03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "id": "5"}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:33.866123 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-882fa945-7f66-49af-9d66-bdc204235b03 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.161490 Jun 08 13:39:33.867000 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 18/34] 10.222.0.55 () {64 vars in 1282 bytes} [Wed Jun 8 13:39:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 13:39:33.880562 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-7b3c462f-3c35-4e33-bc74-c6426e2963e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:39:33.966360 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-7b3c462f-3c35-4e33-bc74-c6426e2963e9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090232 Jun 08 13:39:33.979845 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 17/35] 10.222.0.55 () {64 vars in 1332 bytes} [Wed Jun 8 13:39:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:39:57.501440 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-882fa945-7f66-49af-9d66-bdc204235b03 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:57.502450 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-882fa945-7f66-49af-9d66-bdc204235b03 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 08 13:39:57.502849 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 19/36] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:57.513669 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:57.562989 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-973e49e0-6810-4602-a788-304c87754a2a admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:57.579918 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-973e49e0-6810-4602-a788-304c87754a2a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070880 Jun 08 13:39:57.580479 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 8 13:39:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:39:58.583338 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-882fa945-7f66-49af-9d66-bdc204235b03 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:58.584362 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-882fa945-7f66-49af-9d66-bdc204235b03 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jun 08 13:39:58.584892 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:58.802153 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-c1eef807-77a8-40d1-a956-605f68cefebb admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:58.807988 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.wsgi [None req-c1eef807-77a8-40d1-a956-605f68cefebb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-c1eef807-77a8-40d1-a956-605f68cefebb admin admin] Request method failure captured: Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Accept: application/json Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Accept-Encoding: gzip, deflate Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Connection: keep-alive Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Content-Length: 0 Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Host: 10.222.0.55 Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Openstack-Api-Version: compute 2.90 Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Openstack-System-Scope: None Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: User-Agent: python-novaclient Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Auth-Token: gAAAAABioKau1pvMKMtp6t5by9wPH10GN6JaaYO3xZXdY7gyx3RLq8Q2XqRNWyR7905FE2wbdJVCl3J1llCYo7nBcgrgZHyIMFRBCElSqau42vX5h1ccbCMVTYJ2zutML7a1f_-OjeZPAYayUjwX9Mo1tA2esqR1i_uwJh55X_EO7xg316T_sI8 Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Domain-Id: None Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Domain-Name: None Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Identity-Status: Confirmed Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Is-Admin-Project: True Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Domain-Id: default Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Domain-Name: Default Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Name: admin Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Role: member,admin,reader Jun 08 13:39:58.812950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Roles: member,admin,reader Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c9b429555f24abe8bf7e676e75bbda4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}] Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Tenant: admin Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Tenant-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Tenant-Name: admin Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User: admin Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Domain-Id: default Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Domain-Name: Default Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Id: f3324493261445ea97cf7d9e4edb1c3a Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Name: admin Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: method: > Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: exception: Flavor 42 could not be found. Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: action_args: {'id': '42'} Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:39:58.814395 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:39:58.815255 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.816407 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-c1eef807-77a8-40d1-a956-605f68cefebb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:39:58.817535 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-c1eef807-77a8-40d1-a956-605f68cefebb admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061676 Jun 08 13:39:58.817535 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 8 13:39:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:58.822428 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-4b798cb2-06e8-4204-99ae-b19a4cb62c71 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:58.826133 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:39:58.846854 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-4b798cb2-06e8-4204-99ae-b19a4cb62c71 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028090 Jun 08 13:39:58.847438 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 8 13:39:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:39:58.866459 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-1ed5522f-59de-44a0-a367-5dabbcc1a66c admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:58.888846 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-1ed5522f-59de-44a0-a367-5dabbcc1a66c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026357 Jun 08 13:39:58.889382 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 8 13:39:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:39:58.898834 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-f1c5a14e-54f9-4dda-b5eb-130312ace919 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:58.904609 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.wsgi [None req-f1c5a14e-54f9-4dda-b5eb-130312ace919 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-f1c5a14e-54f9-4dda-b5eb-130312ace919 admin admin] Request method failure captured: Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Accept: application/json Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Accept-Encoding: gzip, deflate Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Connection: keep-alive Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Content-Length: 0 Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Host: 10.222.0.55 Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Openstack-Api-Version: compute 2.90 Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Openstack-System-Scope: None Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: User-Agent: python-novaclient Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Auth-Token: gAAAAABioKau1pvMKMtp6t5by9wPH10GN6JaaYO3xZXdY7gyx3RLq8Q2XqRNWyR7905FE2wbdJVCl3J1llCYo7nBcgrgZHyIMFRBCElSqau42vX5h1ccbCMVTYJ2zutML7a1f_-OjeZPAYayUjwX9Mo1tA2esqR1i_uwJh55X_EO7xg316T_sI8 Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Domain-Id: None Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Domain-Name: None Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Identity-Status: Confirmed Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Is-Admin-Project: True Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Domain-Id: default Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Domain-Name: Default Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Name: admin Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Role: member,admin,reader Jun 08 13:39:58.907804 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Roles: member,admin,reader Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c9b429555f24abe8bf7e676e75bbda4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}] Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Tenant: admin Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Tenant-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Tenant-Name: admin Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User: admin Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Domain-Id: default Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Domain-Name: Default Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Id: f3324493261445ea97cf7d9e4edb1c3a Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Name: admin Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: method: > Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: exception: Flavor 42 could not be found. Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: action_args: {'id': '42'} Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:39:58.912894 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:39:58.913708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:58.914708 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-f1c5a14e-54f9-4dda-b5eb-130312ace919 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:39:58.915825 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-f1c5a14e-54f9-4dda-b5eb-130312ace919 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014331 Jun 08 13:39:58.915825 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 8 13:39:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:59.785552 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-1ed5522f-59de-44a0-a367-5dabbcc1a66c admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:59.786560 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-1ed5522f-59de-44a0-a367-5dabbcc1a66c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 08 13:39:59.786956 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 21/43] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:39:59.976243 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fe007cf5-d064-4198-9446-6c258d66bd56 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:39:59.981967 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.wsgi [None req-fe007cf5-d064-4198-9446-6c258d66bd56 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fe007cf5-d064-4198-9446-6c258d66bd56 admin admin] Request method failure captured: Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Accept: application/json Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Accept-Encoding: gzip, deflate Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Connection: keep-alive Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Content-Length: 0 Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Host: 10.222.0.55 Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Openstack-Api-Version: compute 2.90 Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Openstack-System-Scope: None Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: User-Agent: python-novaclient Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Auth-Token: gAAAAABioKavFTpvonsjBg5jUVhu4d-ADp-tkSoXgu-KgU9Cl3uLSDRP4MTzTHIDWRDPIso7etIstWieSz_Xn-sEbKi3F_KDfu1xgPzLoBZAhCrtQKXk69mdT3NjUIlIFAB3s5nXVmpjiS-C4Qm9JV1UE9T0BnlVvtCJ29-9_wNKA1gOcDHDx1E Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Domain-Id: None Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Domain-Name: None Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Identity-Status: Confirmed Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Is-Admin-Project: True Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Domain-Id: default Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Domain-Name: Default Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Name: admin Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Role: member,admin,reader Jun 08 13:39:59.983474 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Roles: member,admin,reader Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c9b429555f24abe8bf7e676e75bbda4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}] Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Tenant: admin Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Tenant-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Tenant-Name: admin Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User: admin Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Domain-Id: default Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Domain-Name: Default Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Id: f3324493261445ea97cf7d9e4edb1c3a Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Name: admin Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: method: > Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: exception: Flavor 84 could not be found. Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: action_args: {'id': '84'} Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:39:59.985007 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:39:59.986036 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:39:59.987400 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fe007cf5-d064-4198-9446-6c258d66bd56 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:39:59.988653 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-fe007cf5-d064-4198-9446-6c258d66bd56 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061616 Jun 08 13:39:59.988653 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 23/44] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 8 13:39:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 13:39:59.994510 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-b48aee6f-d5eb-48d3-9418-c9035f74dd42 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:00.009200 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-b48aee6f-d5eb-48d3-9418-c9035f74dd42 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018231 Jun 08 13:40:00.009728 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 8 13:39:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:40:00.019215 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fed3ff8e-078d-4b19-af9e-54b2289d3c10 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:00.034123 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-fed3ff8e-078d-4b19-af9e-54b2289d3c10 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018310 Jun 08 13:40:00.034644 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 8 13:40:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:40:00.044885 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-b4267fd7-aa36-43d4-b218-2b7c8221be44 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:00.050260 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.wsgi [None req-b4267fd7-aa36-43d4-b218-2b7c8221be44 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-b4267fd7-aa36-43d4-b218-2b7c8221be44 admin admin] Request method failure captured: Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Accept: application/json Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Accept-Encoding: gzip, deflate Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Connection: keep-alive Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Content-Length: 0 Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Host: 10.222.0.55 Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Openstack-Api-Version: compute 2.90 Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Openstack-System-Scope: None Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: User-Agent: python-novaclient Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Auth-Token: gAAAAABioKavFTpvonsjBg5jUVhu4d-ADp-tkSoXgu-KgU9Cl3uLSDRP4MTzTHIDWRDPIso7etIstWieSz_Xn-sEbKi3F_KDfu1xgPzLoBZAhCrtQKXk69mdT3NjUIlIFAB3s5nXVmpjiS-C4Qm9JV1UE9T0BnlVvtCJ29-9_wNKA1gOcDHDx1E Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Domain-Id: None Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Domain-Name: None Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Identity-Status: Confirmed Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Is-Admin-Project: True Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Domain-Id: default Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Domain-Name: Default Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Name: admin Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Role: member,admin,reader Jun 08 13:40:00.051757 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Roles: member,admin,reader Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c9b429555f24abe8bf7e676e75bbda4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}] Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Tenant: admin Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Tenant-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Tenant-Name: admin Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User: admin Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Domain-Id: default Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Domain-Name: Default Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Id: f3324493261445ea97cf7d9e4edb1c3a Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Name: admin Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: method: > Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: exception: Flavor 84 could not be found. Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: action_args: {'id': '84'} Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:40:00.055770 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:40:00.056768 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:00.059297 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-b4267fd7-aa36-43d4-b218-2b7c8221be44 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:40:00.060735 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-b4267fd7-aa36-43d4-b218-2b7c8221be44 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013052 Jun 08 13:40:00.060735 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 23/47] 10.222.0.55 () {60 vars in 1190 bytes} [Wed Jun 8 13:40:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 08 13:40:00.915833 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-fed3ff8e-078d-4b19-af9e-54b2289d3c10 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:00.916863 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-fed3ff8e-078d-4b19-af9e-54b2289d3c10 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 08 13:40:00.917485 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 25/48] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:40:01.105412 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-1f5046d8-6ce8-440d-bd75-259eec6e6018 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:01.111286 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.wsgi [None req-1f5046d8-6ce8-440d-bd75-259eec6e6018 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-1f5046d8-6ce8-440d-bd75-259eec6e6018 admin admin] Request method failure captured: Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Accept: application/json Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Accept-Encoding: gzip, deflate Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Connection: keep-alive Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Content-Length: 0 Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Host: 10.222.0.55 Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Openstack-Api-Version: compute 2.90 Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Openstack-System-Scope: None Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: User-Agent: python-novaclient Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Auth-Token: gAAAAABioKawYTrwp9pdEO7VbUzAU0BjeUggbC9CPmGIgVf4fSbTTWWjwYrZr8QR9cEhptZmwiGOGXG6hYJkz-J8CqNjTr2S2hzLZTdjFlrPCBwOg-0GgG0-O8YvAuGa9GE6Q45423M3bW6wuGGEe4Nhkd2BRcZEkiBVe3zj4hbsQJtEw5ivMh4 Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Domain-Id: None Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Domain-Name: None Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Identity-Status: Confirmed Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Is-Admin-Project: True Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Domain-Id: default Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Domain-Name: Default Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Project-Name: admin Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Role: member,admin,reader Jun 08 13:40:01.112819 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Roles: member,admin,reader Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c9b429555f24abe8bf7e676e75bbda4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}] Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Tenant: admin Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Tenant-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-Tenant-Name: admin Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User: admin Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Domain-Id: default Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Domain-Name: Default Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Id: f3324493261445ea97cf7d9e4edb1c3a Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: X-User-Name: admin Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: method: > Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: exception: Flavor 451 could not be found. Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: action_args: {'id': '451'} Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:40:01.114435 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:40:01.115508 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.116997 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-1f5046d8-6ce8-440d-bd75-259eec6e6018 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110223) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:40:01.118230 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-1f5046d8-6ce8-440d-bd75-259eec6e6018 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060887 Jun 08 13:40:01.118230 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 24/49] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 8 13:40:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:01.124540 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-8f1d1838-f025-4a24-bc64-67310c99c048 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:01.138161 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-8f1d1838-f025-4a24-bc64-67310c99c048 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017877 Jun 08 13:40:01.138889 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 26/50] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 8 13:40:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:40:01.147742 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:01.161883 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017584 Jun 08 13:40:01.162406 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1210 bytes} [Wed Jun 8 13:40:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:40:01.171775 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-bc653521-0f11-4d13-9b49-3627186ebc13 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:01.176997 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.wsgi [None req-bc653521-0f11-4d13-9b49-3627186ebc13 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-bc653521-0f11-4d13-9b49-3627186ebc13 admin admin] Request method failure captured: Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Accept: application/json Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Accept-Encoding: gzip, deflate Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Connection: keep-alive Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Content-Length: 0 Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Host: 10.222.0.55 Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Openstack-Api-Version: compute 2.90 Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Openstack-System-Scope: None Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: User-Agent: python-novaclient Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Auth-Token: gAAAAABioKawYTrwp9pdEO7VbUzAU0BjeUggbC9CPmGIgVf4fSbTTWWjwYrZr8QR9cEhptZmwiGOGXG6hYJkz-J8CqNjTr2S2hzLZTdjFlrPCBwOg-0GgG0-O8YvAuGa9GE6Q45423M3bW6wuGGEe4Nhkd2BRcZEkiBVe3zj4hbsQJtEw5ivMh4 Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Domain-Id: None Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Domain-Name: None Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Identity-Status: Confirmed Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Is-Admin-Project: True Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Openstack-Nova-Api-Version: 2.90 Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Domain-Id: default Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Domain-Name: Default Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Project-Name: admin Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Role: member,admin,reader Jun 08 13:40:01.178465 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Roles: member,admin,reader Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c9b429555f24abe8bf7e676e75bbda4", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c9b429555f24abe8bf7e676e75bbda4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c9b429555f24abe8bf7e676e75bbda4"}]}] Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Tenant: admin Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Tenant-Id: 2c9b429555f24abe8bf7e676e75bbda4 Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-Tenant-Name: admin Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User: admin Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Domain-Id: default Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Domain-Name: Default Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Id: f3324493261445ea97cf7d9e4edb1c3a Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: X-User-Name: admin Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: method: > Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: exception: Flavor 451 could not be found. Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: action_args: {'id': '451'} Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:40:01.180002 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:40:01.181418 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: ERROR nova.api.openstack.wsgi Jun 08 13:40:01.182970 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-bc653521-0f11-4d13-9b49-3627186ebc13 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110222) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:40:01.184248 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-bc653521-0f11-4d13-9b49-3627186ebc13 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011472 Jun 08 13:40:01.184248 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 27/52] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 8 13:40:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 08 13:40:02.059061 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:02.060076 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 08 13:40:02.060493 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:40:02.248802 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-6a7bd612-2c55-4b10-bf19-df68afb5ae63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:40:02.355501 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-6a7bd612-2c55-4b10-bf19-df68afb5ae63 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.157745 Jun 08 13:40:02.356073 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 28/54] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 8 13:40:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:40:03.244732 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:03.246391 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Jun 08 13:40:03.246795 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:40:03.440198 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-4f1bb4c5-41f4-4fd1-b5cb-8da5762b3f0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:40:03.514553 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-4f1bb4c5-41f4-4fd1-b5cb-8da5762b3f0f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.125808 Jun 08 13:40:03.515024 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 29/56] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 8 13:40:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:40:04.394581 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:04.395594 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 08 13:40:04.395985 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:40:04.580355 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-2175557b-fc7d-4a46-b881-855fc88b7f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:40:04.662412 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-2175557b-fc7d-4a46-b881-855fc88b7f76 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.132601 Jun 08 13:40:04.662870 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 30/58] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 8 13:40:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:40:05.538231 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:05.539230 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 08 13:40:05.539747 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 29/59] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:40:05.729846 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-0ee120c9-3cd3-4ee2-bad5-04cd7997aac8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:40:05.794828 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-0ee120c9-3cd3-4ee2-bad5-04cd7997aac8 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.118284 Jun 08 13:40:05.795372 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1235 bytes} [Wed Jun 8 13:40:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:40:06.658960 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:06.659950 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jun 08 13:40:06.660397 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 30/61] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:40:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:40:06.856092 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-65be2b04-dd09-4fda-872a-2b62537d6054 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:40:06.875590 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-65be2b04-dd09-4fda-872a-2b62537d6054 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073601 Jun 08 13:40:06.876137 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 32/62] 10.222.0.55 () {60 vars in 1202 bytes} [Wed Jun 8 13:40:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:41:08.993553 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:41:08.994621 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-3f81d86f-0bd2-4fec-a55a-57adf38fc0f5 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 08 13:41:08.995043 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 31/63] 10.222.0.55 () {54 vars in 930 bytes} [Wed Jun 8 13:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:41:09.002387 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:41:09.055235 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-f36b41a9-e85e-41da-ad64-a8a125bb2a86 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:41:09.073982 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-f36b41a9-e85e-41da-ad64-a8a125bb2a86 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072947 Jun 08 13:41:09.074517 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1291 bytes} [Wed Jun 8 13:41:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:41:09.095550 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG dbcounter [-] [110223] Writing DB stats nova_api:SELECT=14 {{(pid=110223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:41:09.099269 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-6ad39674-f0ed-4c4c-9e6d-94b778b9b9e9 admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:41:09.107325 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-6ad39674-f0ed-4c4c-9e6d-94b778b9b9e9 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013174 Jun 08 13:41:09.107855 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 32/65] 10.222.0.55 () {60 vars in 1282 bytes} [Wed Jun 8 13:41:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:41:09.119367 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-8dde5cb8-ccbd-4fd6-9d88-f24488ae3597 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:41:09.128688 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-8dde5cb8-ccbd-4fd6-9d88-f24488ae3597 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012917 Jun 08 13:41:09.129221 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 34/66] 10.222.0.55 () {60 vars in 1285 bytes} [Wed Jun 8 13:41:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:41:09.141850 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:41:09.149461 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011256 Jun 08 13:41:09.149982 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1285 bytes} [Wed Jun 8 13:41:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:41:09.161762 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-e3a4e3e9-c2ad-49d1-aec0-eedf0b52cba8 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:41:09.169659 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-e3a4e3e9-c2ad-49d1-aec0-eedf0b52cba8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011384 Jun 08 13:41:09.170166 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1282 bytes} [Wed Jun 8 13:41:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:44:35.539790 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:44:35.540837 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 08 13:44:35.541239 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:44:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:44:35.696042 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_api:SELECT=6 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:44:35.810821 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-494804f1-995d-4ada-a41b-e279fdd4d628 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:44:35.812366 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:44:35.812366 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: warnings.warn(msg) Jun 08 13:44:35.814240 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-494804f1-995d-4ada-a41b-e279fdd4d628 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:44:35.814871 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-494804f1-995d-4ada-a41b-e279fdd4d628 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:44:35.816109 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-494804f1-995d-4ada-a41b-e279fdd4d628 admin admin] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:44:35.816727 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-494804f1-995d-4ada-a41b-e279fdd4d628 admin admin] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:44:35.851403 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-494804f1-995d-4ada-a41b-e279fdd4d628 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156930 Jun 08 13:44:35.851963 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 36/70] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 8 13:44:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:44:36.723895 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:44:36.724907 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 08 13:44:36.725302 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:44:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:44:36.913788 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-35d9f5ae-7389-4625-b42d-60d920eb3014 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:44:36.915008 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:44:36.915008 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: warnings.warn(msg) Jun 08 13:44:36.916220 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-35d9f5ae-7389-4625-b42d-60d920eb3014 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:44:36.916660 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-35d9f5ae-7389-4625-b42d-60d920eb3014 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:44:36.917439 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-35d9f5ae-7389-4625-b42d-60d920eb3014 admin admin] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:44:36.917864 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-35d9f5ae-7389-4625-b42d-60d920eb3014 admin admin] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:44:36.938005 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-35d9f5ae-7389-4625-b42d-60d920eb3014 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075713 Jun 08 13:44:36.938555 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 37/72] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 8 13:44:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:44:48.236571 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:44:48.237494 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 08 13:44:48.237900 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 36/73] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:44:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:44:48.385288 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_cell0:SELECT=4 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:44:48.386008 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_cell1:SELECT=4 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:44:48.386690 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG dbcounter [-] [110222] Writing DB stats nova_api:SELECT=8 {{(pid=110222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:44:48.434769 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-f3b04a8d-c5af-4a46-83df-85c37e124103 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:44:48.435967 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:44:48.435967 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: warnings.warn(msg) Jun 08 13:44:48.437160 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-f3b04a8d-c5af-4a46-83df-85c37e124103 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:44:48.437591 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-f3b04a8d-c5af-4a46-83df-85c37e124103 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:44:48.438360 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-f3b04a8d-c5af-4a46-83df-85c37e124103 admin admin] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:44:48.438779 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-f3b04a8d-c5af-4a46-83df-85c37e124103 admin admin] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:44:48.463929 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-f3b04a8d-c5af-4a46-83df-85c37e124103 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083056 Jun 08 13:44:48.464503 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 8 13:44:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:44:49.329025 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: DEBUG nova.api.openstack.wsgi [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] Calling method '>' {{(pid=110223) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:44:49.330024 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: INFO nova.api.openstack.requestlog [None req-4f85cd1a-5d12-4f19-98bb-e9c7855bd57d admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 08 13:44:49.330430 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: [pid: 110223|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1074 bytes} [Wed Jun 8 13:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:44:49.526547 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG nova.api.openstack.wsgi [None req-97653655-d789-4174-97a9-dd8623faa7a3 admin admin] Calling method '>' {{(pid=110222) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:44:49.527753 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 08 13:44:49.527753 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: warnings.warn(msg) Jun 08 13:44:49.530387 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-97653655-d789-4174-97a9-dd8623faa7a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:44:49.530974 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-97653655-d789-4174-97a9-dd8623faa7a3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:44:49.531766 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-97653655-d789-4174-97a9-dd8623faa7a3 admin admin] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:44:49.532224 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: DEBUG oslo_concurrency.lockutils [None req-97653655-d789-4174-97a9-dd8623faa7a3 admin admin] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110222) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:44:49.556667 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: INFO nova.api.openstack.requestlog [None req-97653655-d789-4174-97a9-dd8623faa7a3 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083813 Jun 08 13:44:49.557162 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: [pid: 110222|app: 0|req: 39/76] 10.222.0.55 () {60 vars in 1193 bytes} [Wed Jun 8 13:44:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:45:46.302797 dv-cinder-819149-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 08 13:45:46.303386 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: Wed Jun 8 13:45:46 2022 - graceful shutdown triggered... Jun 08 13:45:46.303862 dv-cinder-819149-5-iscsi devstack@n-api.service[110223]: Gracefully killing worker 2 (pid: 110223)... Jun 08 13:45:46.304290 dv-cinder-819149-5-iscsi devstack@n-api.service[110222]: Gracefully killing worker 1 (pid: 110222)... Jun 08 13:45:47.304299 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: worker 1 buried after 1 seconds Jun 08 13:45:47.304299 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: worker 2 buried after 1 seconds Jun 08 13:45:47.304299 dv-cinder-819149-5-iscsi devstack@n-api.service[110221]: goodbye to uWSGI. Jun 08 13:45:47.305861 dv-cinder-819149-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 08 13:45:47.306435 dv-cinder-819149-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 08 13:45:47.309373 dv-cinder-819149-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 08 13:45:47.326194 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 8 13:45:47 2022] *** Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: nodename: dv-cinder-819149-5-iscsi Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: machine: x86_64 Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: clock source: unix Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: pcre jit disabled Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: detected number of CPU cores: 4 Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: current working directory: / Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: detected binary path: /usr/bin/uwsgi-core Jun 08 13:45:47.342058 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: your processes number limit is 47680 Jun 08 13:45:47.342919 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: your memory page size is 4096 bytes Jun 08 13:45:47.342919 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: detected max file descriptor number: 2048 Jun 08 13:45:47.342919 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: lock engine: pthread robust mutexes Jun 08 13:45:47.342919 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: thunder lock: enabled Jun 08 13:45:47.342919 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 08 13:45:47.343291 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 08 13:45:47.389081 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: Python main interpreter initialized at 0x56532d7049c0 Jun 08 13:45:47.389081 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: python threads support enabled Jun 08 13:45:47.389081 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: your server socket listen backlog is limited to 100 connections Jun 08 13:45:47.389081 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: your mercy for graceful operations on workers is 90 seconds Jun 08 13:45:47.389542 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: mapped 403077 bytes (393 KB) for 2 cores Jun 08 13:45:47.389542 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: *** Operational MODE: preforking *** Jun 08 13:45:47.389774 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: *** uWSGI is running in multiple interpreter mode *** Jun 08 13:45:47.389774 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: spawned uWSGI master process (pid: 124612) Jun 08 13:45:47.389986 dv-cinder-819149-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 08 13:45:47.392248 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: spawned uWSGI worker 1 (pid: 124628, cores: 1) Jun 08 13:45:47.392248 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: spawned uWSGI worker 2 (pid: 124629, cores: 1) Jun 08 13:45:47.392248 dv-cinder-819149-5-iscsi devstack@n-api.service[124612]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 08 13:45:48.637919 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 08 13:45:48.670838 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 08 13:45:49.472547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:45:49.472547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: from cryptography.utils import int_from_bytes Jun 08 13:45:49.472888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:45:49.472888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: from cryptography.utils import int_from_bytes Jun 08 13:45:49.523739 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:45:49.523739 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: from cryptography.utils import int_from_bytes Jun 08 13:45:49.524099 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 08 13:45:49.524099 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: from cryptography.utils import int_from_bytes Jun 08 13:45:51.880227 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 13:45:51.880807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 13:45:51.881111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 13:45:51.881383 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 13:45:51.881646 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 13:45:51.882041 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.882372 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.882698 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.883024 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.883360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.883677 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.884004 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.884360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.884695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.884992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.885468 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.885810 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-5-iscsi {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.886135 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.886450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.886767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.887092 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.887410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.887738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.888081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.888577 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.889955 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.889955 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.889955 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.890376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.890604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.890921 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.891250 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.891569 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.891897 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.892245 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.892656 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-5-iscsi {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.892988 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.893295 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.893614 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.894041 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.894362 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.894674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.895003 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.895335 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.895644 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.895980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.896358 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.896674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.897009 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.897324 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.897642 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.897961 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.898292 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.898606 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.898923 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.899184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.899501 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.899831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.900186 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.900552 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.900793 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.901054 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.901448 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.901808 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.902129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.902448 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.902763 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.903077 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.903394 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.903707 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.904022 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.904363 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.904689 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.905012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.905341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.905659 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.905989 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.906399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.906675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.906982 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.907325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.907652 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.907968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.908832 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.908832 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.909163 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.909352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.909755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.909924 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.910375 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.910548 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.910739 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.911046 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.911411 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.911734 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.912077 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.912390 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.912706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.913013 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.913324 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.913637 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.913946 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.914259 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.914572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.914882 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.915193 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.915503 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.915812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.916766 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.917247 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.917572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.917893 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.918212 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.918529 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.918860 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.919177 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.919492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.919979 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.920194 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.920458 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.920785 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.921106 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.921433 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.921746 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.922143 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.922353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.922679 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.922991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.923394 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.923874 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.923874 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.924375 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.924693 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.925005 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.925314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.925619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.925952 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.926282 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.926598 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.926911 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.927223 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.927549 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.927898 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.928265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.928621 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.928945 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.929289 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.929631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.929957 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.930279 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.930607 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.930941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.931262 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.931581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.932476 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.932806 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.933139 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.933476 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.933801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.934127 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.934452 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.934768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.935093 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.935430 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.935760 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.936096 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.936449 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.936799 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.937119 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.937478 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.937807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.938125 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.938443 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.938759 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.939085 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.939424 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.939747 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.940160 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.940416 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.940738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.941056 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.941375 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.941732 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.942076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.942399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.942727 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.943047 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.943370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.943688 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.944005 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.944361 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.944687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.944974 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.945286 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.945600 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.945958 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.946288 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.946672 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.946990 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.947709 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.948033 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.948384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.948709 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.949024 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.949341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.949663 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.949986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.950373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.950637 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.950954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.951268 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.951600 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.951916 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.952255 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.952576 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.952691 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 08 13:45:51.953111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.953500 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 08 13:45:51.953610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.953765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 08 13:45:51.953914 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.954049 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 08 13:45:51.954201 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.954343 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 08 13:45:51.954486 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.954628 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.954802 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.954946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.955088 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.955227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.955361 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.955495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.955637 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.955784 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.955917 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.956048 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.956277 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.956412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.956542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.956686 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.956819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.957002 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.957189 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.957324 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.957471 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.957610 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.957742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.957894 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-5-iscsi {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.958030 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.958224 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.958373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.958539 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.958675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.958862 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.958996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.959186 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.959335 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.959497 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.959632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.959866 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.959998 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.960161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.960314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.960455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.960660 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.960811 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.960978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.961127 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.961289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.961424 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.961604 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.961738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.961947 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.962093 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.962269 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.962413 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.962586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.962732 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.963433 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.963589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.963773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.963951 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.964156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.964390 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.964536 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.964713 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.964857 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.965052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.965184 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-5-iscsi {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.965373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.965517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.965693 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.965838 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.966013 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.966157 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.966340 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.966477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.966657 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.966809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.966985 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.967120 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.967303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.967440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.967635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.967769 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.967955 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.968122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.968318 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.968461 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.968630 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.968765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.968953 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.969102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.969303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.969505 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.969639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.969778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.969909 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.970041 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.970226 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.970362 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.970619 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.970772 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.970905 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.971037 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.971177 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.971565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.971698 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.971828 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.971967 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.972196 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.972433 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.972642 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.972842 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.973059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.973227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.973407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.973579 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.973579 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.973931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.974168 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.974475 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.974675 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.974847 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.975077 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.975351 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.975608 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.975898 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.976183 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.976375 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.976524 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.976673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.976817 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.976817 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.977099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.977238 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.977238 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.977541 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.977686 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.977835 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.978110 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.978253 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.978416 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.978597 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.978878 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.979035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.979035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.979332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.979497 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.979497 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.979842 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.979996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.980219 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.980365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.980510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.980664 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.980929 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.981079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.981243 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.981396 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.981569 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.981736 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.981892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.981892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.982175 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.982309 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.982451 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.982596 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.982780 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.982944 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.983085 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.983241 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.983384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.983523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.983757 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.983903 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.984111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.984259 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.984259 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.984545 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.984686 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.984832 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.984999 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.985139 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.985279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.985472 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.985665 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.985841 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.986037 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.986037 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.986363 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.986511 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.986654 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.986795 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.986976 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.987123 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.987266 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.987417 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.987558 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.987698 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.987831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.988023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.988286 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.988434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.988574 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.988730 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.988730 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.989026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.989174 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.989322 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.989472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.989639 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.989780 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.989914 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.990055 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.990214 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.990355 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.990488 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.990646 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.990799 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.990959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.991092 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.991229 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.991450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.991588 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.991830 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.992010 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.992205 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.992353 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.992517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.992667 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.992830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.992995 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.993129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.993290 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.993466 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.993710 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.993890 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.994146 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.994887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.995168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.995309 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.995441 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.995720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.996033 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.996236 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.996395 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.996717 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.996886 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.997054 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.997249 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.997405 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.997695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.997953 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.998144 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.998280 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.998443 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.998636 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.998825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.998972 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.999122 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.999295 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.999485 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:51.999637 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:51.999932 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.000112 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:52.000267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:52.000462 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.000626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 08 13:45:52.000866 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.001081 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.001326 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.001489 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.001674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.001836 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.002029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.002185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.002380 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.002604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.002752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.002884 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.003103 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.003276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.003425 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.003660 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.003825 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.004250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.004536 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.004834 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.005131 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.005374 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.005551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.005719 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.005719 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.005997 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.006165 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.006325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.006477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.006653 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.006827 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.006971 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.007122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.007254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.007401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.007589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.007726 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.007858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.008006 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.008174 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.008333 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.008482 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.008616 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.008755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.008911 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.009078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.009260 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.009532 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.009681 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.010010 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.010179 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.010620 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.010793 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.011027 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.011211 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.011377 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.011513 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.011653 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.011833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.011983 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.012216 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.012366 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.012625 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.012805 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.012955 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.013126 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.013314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.013465 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.013639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.013905 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.014087 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.014319 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.014523 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.014667 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.014806 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.014987 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.015133 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.015338 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.015485 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.015691 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.015868 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.016038 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.016407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.016567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.016852 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.016990 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.017123 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.017289 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.017436 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.017672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.017851 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.017986 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.018276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.018412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.018544 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.018689 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.018869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.019079 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.019253 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.019433 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.019605 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.019810 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.019995 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.020262 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.020408 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.020612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.020803 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.020956 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.021090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.021223 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.021379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.021542 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.021772 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.021927 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.022113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.022250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.022438 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.022685 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.022946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.023084 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.023245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.023386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.023528 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.023698 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.023846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.024003 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.024242 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.024387 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.024529 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.024715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.024902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.025045 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.025307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.025984 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.026187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.026332 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.026474 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.026694 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.026990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.027119 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.027247 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.027390 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.027523 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.027709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.027881 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.028023 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.028235 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.028386 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.028552 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.028735 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.028900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.029071 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.029231 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.029380 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.029543 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.029709 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.029847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.029987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.030170 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.030321 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.030504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.030640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.030821 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.031034 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.031250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.031383 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.031497 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.031650 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.031789 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.031926 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.044255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.044360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.044448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.044448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.044602 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.044699 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.044869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045021 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045146 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045550 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045647 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045748 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045834 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.045919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046033 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046130 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046205 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046298 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046390 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046575 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046669 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046763 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.046942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047027 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047124 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047217 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047302 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047394 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047479 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047563 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047716 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047859 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.047951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048036 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048274 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048511 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048698 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048793 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048889 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.048976 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.049062 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.049153 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.049239 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.049331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.049427 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.049562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.049652 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.049749 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.049844 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.050025 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.050025 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.050203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.050296 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.050391 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.050477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.050576 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.050851 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.050961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051050 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051219 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051408 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051784 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051876 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.051980 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052096 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052296 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052385 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052572 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052659 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052790 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052892 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.052979 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053073 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053170 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053262 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053356 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053604 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053714 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053802 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.053981 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054075 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054336 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054422 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054505 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054598 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054683 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054683 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054858 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.054944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055028 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055120 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055219 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055219 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055391 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055561 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055737 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055823 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055908 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.055992 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.056095 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.056194 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.056295 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.056382 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.056475 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.056569 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.057200 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.057375 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.057482 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.057571 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.057666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.057794 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.057922 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058036 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058145 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058234 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058318 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058403 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058494 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058629 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058753 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058876 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.058996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059119 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059240 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059376 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059472 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059567 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059700 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059795 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059881 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.059976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.060225 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.060225 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.060414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.060510 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.060610 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.061395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.061505 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.061594 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.061734 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.061921 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062122 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062210 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062296 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062380 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062484 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062572 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062657 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062877 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.062980 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063168 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063261 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063347 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063431 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063705 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063796 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063895 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.063989 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064120 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064219 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064400 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064484 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064569 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064663 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064835 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.064928 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065022 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065114 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065389 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065482 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065579 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065678 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065772 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065865 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.065968 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.066062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.066157 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.066323 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.066420 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.066506 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.066694 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.066831 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.067012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.067147 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.067447 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.067637 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.067776 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.067975 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.068208 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.068386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.068545 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.068697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.068869 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.069014 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.069210 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.069355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.069561 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.069738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.069901 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.070049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.070201 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.070356 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.070502 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.070650 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.070805 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.070960 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.071107 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.071261 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.071408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.071560 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.071729 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.071877 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.072030 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.072249 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.072449 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.072678 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.073121 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.073228 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.073445 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.073551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.074325 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.074493 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.074636 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.074824 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.074971 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.075153 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.075300 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.075502 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.075640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.075828 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.075964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.076187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.076322 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.076505 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.076641 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.076821 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.076959 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.077135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.077287 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.077449 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.077602 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.077770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.077904 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.078088 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.078238 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.078403 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.078570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.078749 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.078879 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.079070 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.079205 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.079384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.079507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.079698 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.079827 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.080012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.080166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.080356 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.080477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.080673 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.080793 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.084943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.085093 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.085227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.085335 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.085424 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.085517 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.085603 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.085677 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.085677 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.086709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.086709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.086931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.087061 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.087184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.087311 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.087427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.087541 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.087662 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.087784 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.087906 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.088154 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.088284 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.088400 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.088529 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.088644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.088766 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.088887 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.089010 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.089124 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.089248 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.089371 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.089486 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.089599 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.089721 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.089844 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.089972 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.090095 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.090217 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.090339 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.090453 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.090567 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.090689 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.090803 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.090917 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.091037 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.091159 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.091358 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.091485 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.091602 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.091602 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.091824 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.091967 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.092135 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.092257 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.092370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.092495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.092617 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.092738 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.092867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.093001 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.093144 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.093345 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.093473 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.093588 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.093713 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.093837 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.093964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.094079 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.094206 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.094329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.094443 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.094564 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.094684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.094806 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.094928 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.095052 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.095174 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.095930 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.095930 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.096469 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.096634 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.096767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.096916 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.097050 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.097201 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.097342 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.097521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.097674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.097806 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.097947 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.098167 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.098302 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.098434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.098574 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.098715 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.098857 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.098992 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.099123 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.099255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.099386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.099529 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.099631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.099726 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.099820 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.099906 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.099999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100124 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100232 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100321 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100405 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100498 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100593 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100780 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.100960 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101053 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101139 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101232 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101498 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101583 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101667 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101760 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101846 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.101983 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.102116 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.102255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.102255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.102587 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.102722 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.102854 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.102854 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.103128 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.103128 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.103470 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.103634 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.103778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.103778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.103952 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.103952 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.104201 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.104462 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.104564 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.104880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.104982 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.105196 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.105293 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.105514 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.105610 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.105831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.105976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.106146 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.106292 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.106465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.106608 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.106777 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.106925 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.107088 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.107224 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.107409 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.107543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.107719 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.107883 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.108549 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.108707 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.108843 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.108976 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.109115 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.109258 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.109392 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.109525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.109664 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.109805 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.109938 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.110079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.110212 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.110352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.110494 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.110637 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.110784 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.110925 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.111066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.111199 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.111331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.111462 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.111607 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.111781 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.111916 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.112118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.112267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.112409 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.112553 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.112695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.112828 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.113007 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.113145 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.113315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.113483 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.113685 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.113820 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.113960 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.114100 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.114244 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.114388 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.114529 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.114754 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.114898 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.115077 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.115228 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.115399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.115536 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.115705 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.115840 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.116012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.116191 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.116327 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.116459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.116638 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.116787 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.116952 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.117099 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.117257 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.117401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.117568 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.117704 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.117875 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.118020 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.118188 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.118333 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.118482 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.118631 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.118797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.118950 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.119656 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.119883 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.120227 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.120383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.120529 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.120792 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.120937 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.121140 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.121274 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.121455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.121610 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.121781 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.121925 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.122094 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.122230 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.122407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.122544 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.122755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.122900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.123074 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.123211 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.123439 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.123608 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.123770 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.123946 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.124113 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.124293 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.124444 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.124628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.124764 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.124961 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.125123 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.125275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.125418 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.125572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.125708 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.125879 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.126023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.126260 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.126414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.126547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.126679 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.126810 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.127028 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.127179 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.127365 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.127509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.127688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.127834 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.127996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.128186 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.128323 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.128446 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.128633 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.128769 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.128969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.129108 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.129282 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.129427 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.129568 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.129709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.129857 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.129991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.130138 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.130353 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.130510 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.130653 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.130797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.130931 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.131062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.131201 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.131400 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.131541 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.131684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.131826 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.131995 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.132166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.132359 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.132565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.132727 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.132861 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.132993 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.133123 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.133293 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.133436 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.133610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.133745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.133940 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.134084 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.134253 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.134399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.134562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.134707 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.135507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.135648 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.135862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.136128 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.136268 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.136464 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.136608 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.136786 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.136930 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.137136 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.137270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.137453 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.137586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.137764 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.137911 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.138087 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.138231 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.138399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.138542 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.138731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.138882 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.139078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.139213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.139410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.139552 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.139737 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.139872 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.140041 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.140204 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.140369 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.140505 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.140675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.140818 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.140984 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.141118 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.141304 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.141447 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.141612 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.141748 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.141917 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.142060 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.142219 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.142363 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.142510 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.143350 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.143493 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.143626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.143769 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.143902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.144033 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.144189 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.144315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.144446 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.144591 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.145363 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.145520 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.145656 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.145788 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.145921 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.146061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.146210 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.146345 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.146477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.146610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.146750 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.146897 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.147047 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.147191 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.147333 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.147468 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.147600 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.147742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.147883 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.148024 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.148024 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.148328 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.148472 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.148615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.148749 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.148882 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.149013 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.149145 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.149278 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.149424 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.149558 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.149690 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.149822 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.149957 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.150100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.150232 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.150374 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.150536 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.150680 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.150814 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.150954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.151088 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.151219 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.151359 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.151501 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.151501 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.151764 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.151905 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.152046 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.152200 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.152344 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.152479 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.152479 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.152752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.152886 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.153018 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.153157 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.153304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.153446 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.153588 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.153721 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.153853 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.153984 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.154129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.154263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.154394 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.154526 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.154686 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.154831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.155005 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.155149 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.155322 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.155458 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.155639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.155865 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.156009 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.156168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.156301 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.156446 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.156641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.156788 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.156983 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.157125 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.157462 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.157619 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.157762 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.157906 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.158040 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.158172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.158304 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.158435 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.158576 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.158719 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.158864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.159005 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.159169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.159315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.159499 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.159644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.159821 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.159955 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.160167 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.160307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.160488 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.160633 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.160809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.160945 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.161131 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.161280 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.161447 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.161589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.161785 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.161930 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.162072 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 13:45:52.162221 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.162363 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.162685 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.163018 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.163361 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.163690 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.164013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.164358 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.164681 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.165210 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.165539 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.165886 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.166747 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.166900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.167213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.167545 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.167884 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.168232 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.168552 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.168873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.169194 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.169508 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.169839 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.170161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.170477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.170808 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.171128 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.171675 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.172038 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.172392 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.172730 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.173067 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.173396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.173713 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.174274 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.174425 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.174657 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.174981 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.175300 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.175613 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.175924 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.176265 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.176587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.176899 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.177218 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.177528 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.177864 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.178177 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.178488 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.178800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.179122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.179434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.179745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.180073 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.180392 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.180710 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.181022 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.181338 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.182172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.182718 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.183094 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.183416 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.183795 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.184167 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.184485 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.184800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.185123 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.185442 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.185774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.186094 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.186413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.186767 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.187090 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.187632 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.187975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.188329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.188670 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.189007 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.189324 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.189637 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.189949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.190281 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.190599 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.190916 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.191234 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.191552 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.191869 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.192210 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.192534 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.192850 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.193166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.193481 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.193797 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.194112 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.194428 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.194752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.195106 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.195435 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.195761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.196103 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.196431 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.196748 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.197068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.198117 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.198688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.199068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.199415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.199746 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.200081 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.200525 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.200853 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.201185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.201520 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.201839 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.202172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.202511 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.202831 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.203162 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.203481 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.203820 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.204199 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.204542 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.204877 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.205193 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.205507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.205821 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.206139 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.206465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.206783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.207096 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.207408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.207725 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.208036 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.208365 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.208677 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.208988 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.209303 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.209612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.209920 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.210230 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.210540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.210849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.211160 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.211476 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.211784 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.212126 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.212444 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.212751 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.213103 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.213723 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.214176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.214509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.214847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.215172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.215507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.215829 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.216191 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.216525 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.216850 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.217169 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.217512 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.217832 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.218156 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.218478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.218798 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.219116 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.219435 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.219770 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.220136 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.220455 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.220788 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.221119 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.221699 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.222025 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.222344 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.222583 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO dbcounter [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Registered counter for database nova_api Jun 08 13:45:52.222731 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.222994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.223313 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.223641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.223963 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.224313 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.224640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.224967 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.225307 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.225640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.225960 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.226309 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.226632 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.226990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.227313 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.227666 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.228004 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.228353 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.228750 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.229309 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 08 13:45:52.229566 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 08 13:45:52.242290 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_db.sqlalchemy.engines [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:45:52.249526 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writer thread running {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:45:52.292914 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO dbcounter [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Registered counter for database nova_api Jun 08 13:45:52.306301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.context [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e34c71c5-8d83-411d-9d43-2dd085938513(cell1) {{(pid=124629) load_cells /opt/stack/nova/nova/context.py:464}} Jun 08 13:45:52.311097 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:45:52.312749 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:45:52.313442 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_db.sqlalchemy.engines [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:45:52.313580 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:45:52.315546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:45:52.317572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO dbcounter [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Registered counter for database nova_cell0 Jun 08 13:45:52.319923 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writer thread running {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:45:52.323518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO dbcounter [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Registered counter for database nova_cell1 Jun 08 13:45:52.330814 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_db.sqlalchemy.engines [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:45:52.332962 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_db.sqlalchemy.engines [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:45:52.340505 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writer thread running {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:45:52.341821 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writer thread running {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:45:52.381093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.context [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e34c71c5-8d83-411d-9d43-2dd085938513(cell1) {{(pid=124628) load_cells /opt/stack/nova/nova/context.py:464}} Jun 08 13:45:52.385858 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:45:52.387485 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:45:52.388352 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:45:52.390355 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:45:52.392371 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO dbcounter [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Registered counter for database nova_cell0 Jun 08 13:45:52.397852 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO dbcounter [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Registered counter for database nova_cell1 Jun 08 13:45:52.410684 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_db.sqlalchemy.engines [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:45:52.410684 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_db.sqlalchemy.engines [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:45:52.414490 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writer thread running {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:45:52.415763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writer thread running {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:45:52.492715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO dbcounter [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Registered counter for database nova_cell0 Jun 08 13:45:52.500156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_db.sqlalchemy.engines [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:45:52.504816 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writer thread running {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:45:52.570819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO dbcounter [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Registered counter for database nova_cell0 Jun 08 13:45:52.578303 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_db.sqlalchemy.engines [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 08 13:45:52.583050 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writer thread running {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 08 13:45:52.942981 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: WARNING keystonemiddleware.auth_token [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 13:45:52.951157 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: WARNING keystonemiddleware.auth_token [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 13:45:53.042601 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: WARNING keystonemiddleware.auth_token [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 13:45:53.052646 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: WARNING keystonemiddleware.auth_token [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 13:45:53.179908 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: WARNING keystonemiddleware.auth_token [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 13:45:53.186346 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: WARNING keystonemiddleware.auth_token [None req-82f1d58c-599d-4d95-a613-56d005fb9685 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 13:45:53.191464 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56532d7049c0 pid: 124629 (default app) Jun 08 13:45:53.286561 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: WARNING keystonemiddleware.auth_token [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 08 13:45:53.293084 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: WARNING keystonemiddleware.auth_token [None req-a2970583-d5e7-4677-bcdd-9422226ef5ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 08 13:45:53.298250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56532d7049c0 pid: 124628 (default app) Jun 08 13:46:35.545478 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:35.546641 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:35.547440 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:35.548299 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:36.946359 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d874022f-7e7b-4dc1-893d-943f131c0863 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Action: 'create', calling method: .version_select at 0x7fe28b5805e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-561945503", "metadata": {"Type": "work"}}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d874022f-7e7b-4dc1-893d-943f131c0863 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Request method failure captured: Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 121 Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKg7CRiZuvgLnk9ad-Z_460m-Q6yjNV0kyuubHTXwMpYgLojMRTZS9Flt26WYbp92z5ihuUVoI1oT_FfWYFAE-ez2AX-qklcNxRbIW6Mnjs27v5xaLLCbFcEHIWOxayLY-ndIgCJcp9iOpgmT0xKc1S9hc39D_gXCUKPGdxPzxPracY Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:46:36.972349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_4613903d92f44ca284ebffce3961204d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/4613903d92f44ca284ebffce3961204d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}] Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e6a2825f34ec4adf90cac06ec981bc42 Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-561945503", "metadata": {"Type": "work"}}} Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: Jun 08 13:46:36.974045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-561945503', 'metadata': {'Type': 'work'}}}} Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise error Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi '#$%' Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:46:36.974896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 08 13:46:36.976353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 08 13:46:36.978123 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 08 13:46:36.978123 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:36.978123 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d874022f-7e7b-4dc1-893d-943f131c0863 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:46:36.978123 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d874022f-7e7b-4dc1-893d-943f131c0863 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.425111 Jun 08 13:46:36.978123 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 8 13:46:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1428 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:46:36.979050 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:36.983062 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:36.983062 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:36.983062 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:37.230034 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-de96937e-df51-461c-9b2a-ab673e0e9971 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Action: 'create', calling method: .version_select at 0x7fe28b7fe790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2066306478", "metadata": {"Type": "work"}}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-de96937e-df51-461c-9b2a-ab673e0e9971 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Request method failure captured: Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 120 Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKg7CRiZuvgLnk9ad-Z_460m-Q6yjNV0kyuubHTXwMpYgLojMRTZS9Flt26WYbp92z5ihuUVoI1oT_FfWYFAE-ez2AX-qklcNxRbIW6Mnjs27v5xaLLCbFcEHIWOxayLY-ndIgCJcp9iOpgmT0xKc1S9hc39D_gXCUKPGdxPzxPracY Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:46:37.234163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_4613903d92f44ca284ebffce3961204d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/4613903d92f44ca284ebffce3961204d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}] Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: e6a2825f34ec4adf90cac06ec981bc42 Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2066306478", "metadata": {"Type": "work"}}} Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: Jun 08 13:46:37.235478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2066306478', 'metadata': {'Type': 'work'}}}} Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise error Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi '0' Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:46:37.236612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 08 13:46:37.237867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 08 13:46:37.241509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 08 13:46:37.241509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.241509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-de96937e-df51-461c-9b2a-ab673e0e9971 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:46:37.241509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-de96937e-df51-461c-9b2a-ab673e0e9971 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.262682 Jun 08 13:46:37.246396 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a7ee4c65-cd2c-4af9-be5b-46445ca1b042 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Action: 'create', calling method: .version_select at 0x7fe28b594940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-872109264", "metadata": {"Type": "work"}}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a7ee4c65-cd2c-4af9-be5b-46445ca1b042 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Request method failure captured: Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 118 Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKg7CRiZuvgLnk9ad-Z_460m-Q6yjNV0kyuubHTXwMpYgLojMRTZS9Flt26WYbp92z5ihuUVoI1oT_FfWYFAE-ez2AX-qklcNxRbIW6Mnjs27v5xaLLCbFcEHIWOxayLY-ndIgCJcp9iOpgmT0xKc1S9hc39D_gXCUKPGdxPzxPracY Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:46:37.249172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_4613903d92f44ca284ebffce3961204d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/4613903d92f44ca284ebffce3961204d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}] Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e6a2825f34ec4adf90cac06ec981bc42 Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-872109264", "metadata": {"Type": "work"}}} Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: Jun 08 13:46:37.250461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-872109264', 'metadata': {'Type': 'work'}}}} Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise error Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi '' Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:46:37.251254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 08 13:46:37.253425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 08 13:46:37.254495 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 08 13:46:37.254495 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.254495 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a7ee4c65-cd2c-4af9-be5b-46445ca1b042 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:46:37.254495 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a7ee4c65-cd2c-4af9-be5b-46445ca1b042 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008527 Jun 08 13:46:37.254763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 1/2] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 8 13:46:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:46:37.257497 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 8 13:46:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 08 13:46:37.263322 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b29baa3c-54e6-4084-825e-b0c504c31977 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Calling method '.version_select at 0x7fe28b4c45e0>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:37.981081 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-b29baa3c-54e6-4084-825e-b0c504c31977 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] HTTP exception thrown: Volume tempest-invalid-1693892668 could not be found. Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b29baa3c-54e6-4084-825e-b0c504c31977 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Request method failure captured: Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1693892668 HTTP/1.1 Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKg7CRiZuvgLnk9ad-Z_460m-Q6yjNV0kyuubHTXwMpYgLojMRTZS9Flt26WYbp92z5ihuUVoI1oT_FfWYFAE-ez2AX-qklcNxRbIW6Mnjs27v5xaLLCbFcEHIWOxayLY-ndIgCJcp9iOpgmT0xKc1S9hc39D_gXCUKPGdxPzxPracY Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:46:37.994029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_4613903d92f44ca284ebffce3961204d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/4613903d92f44ca284ebffce3961204d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}] Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: e6a2825f34ec4adf90cac06ec981bc42 Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Volume tempest-invalid-1693892668 could not be found. Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'tempest-invalid-1693892668'} Jun 08 13:46:37.995332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1693892668 could not be found. (HTTP 404) (Request-ID: req-feb771ac-10dd-4ee5-92f7-ca2b505c0519) Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:37.996166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 13:46:37.997346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1693892668 could not be found. Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:46:37.998609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1693892668 could not be found. Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1693892668 could not be found. Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b29baa3c-54e6-4084-825e-b0c504c31977 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Returning 404 to user: Volume tempest-invalid-1693892668 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:46:37.999774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b29baa3c-54e6-4084-825e-b0c504c31977 tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1693892668" status: 404 len: 99 microversion: 2.1 time: 0.734198 Jun 08 13:46:38.005200 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 8 13:46:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1693892668 => generated 99 bytes in 744 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 08 13:46:38.011964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-57a4da65-8ff7-4fc1-b536-365203144a5f tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007063 Jun 08 13:46:38.013972 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 3/5] 10.222.0.55 () {58 vars in 1139 bytes} [Wed Jun 8 13:46:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 08 13:46:38.024238 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-41ddc46e-9bc9-49c8-b36e-ce1b9f6c2d6d tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004353 Jun 08 13:46:38.026856 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 3/6] 10.222.0.55 () {58 vars in 1136 bytes} [Wed Jun 8 13:46:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 08 13:46:38.044145 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b65361bc-883d-4618-917f-4bc0c2cd546a tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Calling method '.version_select at 0x7fe28b6b3f70>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:38.513599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-b65361bc-883d-4618-917f-4bc0c2cd546a tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] HTTP exception thrown: Volume 4f393c63-ae50-4dfe-8fd5-494964310b1e could not be found. Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b65361bc-883d-4618-917f-4bc0c2cd546a tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Request method failure captured: Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: DELETE /compute/v2.1/os-volumes/4f393c63-ae50-4dfe-8fd5-494964310b1e HTTP/1.1 Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKg7CRiZuvgLnk9ad-Z_460m-Q6yjNV0kyuubHTXwMpYgLojMRTZS9Flt26WYbp92z5ihuUVoI1oT_FfWYFAE-ez2AX-qklcNxRbIW6Mnjs27v5xaLLCbFcEHIWOxayLY-ndIgCJcp9iOpgmT0xKc1S9hc39D_gXCUKPGdxPzxPracY Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:46:38.527393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_4613903d92f44ca284ebffce3961204d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/4613903d92f44ca284ebffce3961204d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}] Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e6a2825f34ec4adf90cac06ec981bc42 Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Volume 4f393c63-ae50-4dfe-8fd5-494964310b1e could not be found. Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '4f393c63-ae50-4dfe-8fd5-494964310b1e'} Jun 08 13:46:38.529049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f393c63-ae50-4dfe-8fd5-494964310b1e could not be found. (HTTP 404) (Request-ID: req-b08c43d0-34ce-4355-96ce-7ae8590c73cd) Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:38.529986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 13:46:38.532432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f393c63-ae50-4dfe-8fd5-494964310b1e could not be found. Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 08 13:46:38.533880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f393c63-ae50-4dfe-8fd5-494964310b1e could not be found. Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f393c63-ae50-4dfe-8fd5-494964310b1e could not be found. Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b65361bc-883d-4618-917f-4bc0c2cd546a tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Returning 404 to user: Volume 4f393c63-ae50-4dfe-8fd5-494964310b1e could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b65361bc-883d-4618-917f-4bc0c2cd546a tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/4f393c63-ae50-4dfe-8fd5-494964310b1e" status: 404 len: 109 microversion: 2.1 time: 0.480298 Jun 08 13:46:38.537161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:46:38 2022] DELETE /compute/v2.1/os-volumes/4f393c63-ae50-4dfe-8fd5-494964310b1e => generated 109 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:46:38.539532 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-370ac574-cca9-4cf0-997d-fb27516badfe tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Calling method '.version_select at 0x7fe28b580670>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-370ac574-cca9-4cf0-997d-fb27516badfe tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] HTTP exception thrown: Volume f2dc4554-1684-465b-b618-6eda36100c15 could not be found. Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-370ac574-cca9-4cf0-997d-fb27516badfe tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Request method failure captured: Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/os-volumes/f2dc4554-1684-465b-b618-6eda36100c15 HTTP/1.1 Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKg7CRiZuvgLnk9ad-Z_460m-Q6yjNV0kyuubHTXwMpYgLojMRTZS9Flt26WYbp92z5ihuUVoI1oT_FfWYFAE-ez2AX-qklcNxRbIW6Mnjs27v5xaLLCbFcEHIWOxayLY-ndIgCJcp9iOpgmT0xKc1S9hc39D_gXCUKPGdxPzxPracY Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:46:38.616297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_4613903d92f44ca284ebffce3961204d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/4613903d92f44ca284ebffce3961204d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/4613903d92f44ca284ebffce3961204d"}]}] Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 4613903d92f44ca284ebffce3961204d Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-VolumesNegativeTest-1186790879 Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e6a2825f34ec4adf90cac06ec981bc42 Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-VolumesNegativeTest-1186790879-project Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Volume f2dc4554-1684-465b-b618-6eda36100c15 could not be found. Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'f2dc4554-1684-465b-b618-6eda36100c15'} Jun 08 13:46:38.618666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2dc4554-1684-465b-b618-6eda36100c15 could not be found. (HTTP 404) (Request-ID: req-96d3f4f2-496b-4192-8073-838d0c0e2e42) Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:38.897065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:46:38.900395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2dc4554-1684-465b-b618-6eda36100c15 could not be found. Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 08 13:46:38.901942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2dc4554-1684-465b-b618-6eda36100c15 could not be found. Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2dc4554-1684-465b-b618-6eda36100c15 could not be found. Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-370ac574-cca9-4cf0-997d-fb27516badfe tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] Returning 404 to user: Volume f2dc4554-1684-465b-b618-6eda36100c15 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-370ac574-cca9-4cf0-997d-fb27516badfe tempest-VolumesNegativeTest-1186790879 tempest-VolumesNegativeTest-1186790879-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/f2dc4554-1684-465b-b618-6eda36100c15" status: 404 len: 109 microversion: 2.1 time: 0.087877 Jun 08 13:46:38.902999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 5/8] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:46:38 2022] GET /compute/v2.1/os-volumes/f2dc4554-1684-465b-b618-6eda36100c15 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 13:46:38.903719 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-214628477", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "networks": [{"uuid": "aade4219-e25a-4e36-bcb1-dc2ec86e256b"}]}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:46:38.903719 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] validate_networks() for [('aade4219-e25a-4e36-bcb1-dc2ec86e256b', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:46:40.481331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:46:40.482506 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:46:40.483273 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:46:40.483961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:46:40.484550 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:46:40.508872 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:40.509322 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:40.510113 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:40.516178 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:40.570704 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5ace664b-a795-4481-ab0a-bfad4fbbbba2 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28b3db8b0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:40.605454 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Getting quotas for project 9e6598a073a442958076b48bed28c472. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:46:40.619386 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Getting quotas for user 8fd00cf03b884d8999591ae4db0c1bc5 and project 9e6598a073a442958076b48bed28c472. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:46:40.649188 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:46:40.651565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5ace664b-a795-4481-ab0a-bfad4fbbbba2 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/7c3a32a2-f71e-4a28-aa29-892a05685840" status: 200 len: 351 microversion: 2.1 time: 0.085146 Jun 08 13:46:40.652971 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 6/9] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:46:40 2022] GET /compute/v2.1/os-volumes/7c3a32a2-f71e-4a28-aa29-892a05685840 => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:46:40.659925 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:46:40.877704 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5d9528df-4c86-455e-8362-0fbc24322eba tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.360910 Jun 08 13:46:40.878349 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 4/10] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:46:40.888704 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-34425822-1ea3-444e-98a0-4ef9d00797cf tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:40.890032 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-34425822-1ea3-444e-98a0-4ef9d00797cf tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:41.056206 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-34425822-1ea3-444e-98a0-4ef9d00797cf tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:41.120945 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-34425822-1ea3-444e-98a0-4ef9d00797cf tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1214 microversion: 2.1 time: 0.236036 Jun 08 13:46:41.123929 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 7/11] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:40 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:42.144207 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1bbb0f4c-7666-4342-a804-9020070bd2a5 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:42.144855 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1bbb0f4c-7666-4342-a804-9020070bd2a5 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:42.413896 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1bbb0f4c-7666-4342-a804-9020070bd2a5 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:42.433102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1bbb0f4c-7666-4342-a804-9020070bd2a5 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1214 microversion: 2.1 time: 0.296088 Jun 08 13:46:42.433986 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 5/12] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:42 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:42.750767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-dacce43d-03e3-42b8-a9f0-cdf290d8ec5b tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28b3e54c0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:42.859763 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-dacce43d-03e3-42b8-a9f0-cdf290d8ec5b tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/c22c092f-23d9-45c3-a67b-6154ba809aae" status: 200 len: 350 microversion: 2.1 time: 0.117325 Jun 08 13:46:42.866274 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 8/13] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:46:42 2022] GET /compute/v2.1/os-volumes/c22c092f-23d9-45c3-a67b-6154ba809aae => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:46:43.453936 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-32c28386-e58a-4f55-b6b8-ec3d055c5f47 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:43.458067 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-32c28386-e58a-4f55-b6b8-ec3d055c5f47 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:44.111026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-32c28386-e58a-4f55-b6b8-ec3d055c5f47 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:44.120827 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-32c28386-e58a-4f55-b6b8-ec3d055c5f47 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1214 microversion: 2.1 time: 0.672964 Jun 08 13:46:44.133218 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 6/14] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:43 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1214 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:44.927943 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c29a84c8-bf92-40ba-bb40-8b5528fbed64 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28b39e9d0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:45.025867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c29a84c8-bf92-40ba-bb40-8b5528fbed64 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2dca89f3-84fb-42c1-bcf2-78fe5943fa6c" status: 200 len: 350 microversion: 2.1 time: 0.102018 Jun 08 13:46:45.033185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 9/15] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:46:44 2022] GET /compute/v2.1/os-volumes/2dca89f3-84fb-42c1-bcf2-78fe5943fa6c => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:46:45.039354 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-978a160b-5e79-4f6a-872c-5b87b073c5d5 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28a2941f0>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:45.140765 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a2572a12-dd95-4cff-9c82-46a111de1eca tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:45.140765 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a2572a12-dd95-4cff-9c82-46a111de1eca tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:45.158872 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2572a12-dd95-4cff-9c82-46a111de1eca tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:45.159520 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2572a12-dd95-4cff-9c82-46a111de1eca tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:45.165942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2572a12-dd95-4cff-9c82-46a111de1eca tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:45.166556 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2572a12-dd95-4cff-9c82-46a111de1eca tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:45.220572 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-978a160b-5e79-4f6a-872c-5b87b073c5d5 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.172679 Jun 08 13:46:45.220572 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 7/16] 10.222.0.55 () {58 vars in 1133 bytes} [Wed Jun 8 13:46:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:45.225966 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4bdcdbf1-88c5-4f2c-9bf9-b54275178891 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28a294dc0>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:45.373536 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4bdcdbf1-88c5-4f2c-9bf9-b54275178891 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.155632 Jun 08 13:46:45.374114 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 8/17] 10.222.0.55 () {58 vars in 1148 bytes} [Wed Jun 8 13:46:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:46:45.386127 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7e49cb18-c395-4a33-99fb-71b85cb44210 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28a294700>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:45.635971 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7e49cb18-c395-4a33-99fb-71b85cb44210 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.253922 Jun 08 13:46:45.636577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 9/18] 10.222.0.55 () {58 vars in 1133 bytes} [Wed Jun 8 13:46:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:46:45.650612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-95dc1e1b-c114-48eb-977b-5333ab6c8d2d tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28a282ee0>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:45.741221 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a2572a12-dd95-4cff-9c82-46a111de1eca tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:45.787162 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a2572a12-dd95-4cff-9c82-46a111de1eca tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1210 microversion: 2.1 time: 0.634707 Jun 08 13:46:45.798578 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 10/19] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:45 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1210 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:46:45.925649 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-95dc1e1b-c114-48eb-977b-5333ab6c8d2d tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.281647 Jun 08 13:46:45.927277 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 10/20] 10.222.0.55 () {58 vars in 1166 bytes} [Wed Jun 8 13:46:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:46:45.939774 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-eeb596cb-9c76-415d-a56d-6523192cf345 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28b32f0d0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:46.105198 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-eeb596cb-9c76-415d-a56d-6523192cf345 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.169822 Jun 08 13:46:46.106174 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 11/21] 10.222.0.55 () {58 vars in 1169 bytes} [Wed Jun 8 13:46:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:46:46.119211 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3698c310-d66f-4a42-b3ce-57a9698976e6 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28a298820>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:46.302573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3698c310-d66f-4a42-b3ce-57a9698976e6 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.188216 Jun 08 13:46:46.303147 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 11/22] 10.222.0.55 () {58 vars in 1154 bytes} [Wed Jun 8 13:46:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:46.316183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3958e397-aa12-482e-be17-b0ad3cc58535 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28b2c1430>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:46.490074 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3958e397-aa12-482e-be17-b0ad3cc58535 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.178214 Jun 08 13:46:46.493805 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 12/23] 10.222.0.55 () {58 vars in 1187 bytes} [Wed Jun 8 13:46:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:46:46.509034 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-98cc21a8-442d-43a6-84a1-ceaf07a28138 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] Calling method '.version_select at 0x7fe28a2989d0>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:46.673336 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-98cc21a8-442d-43a6-84a1-ceaf07a28138 tempest-VolumesTestJSON-910284365 tempest-VolumesTestJSON-910284365-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.172653 Jun 08 13:46:46.691740 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 12/24] 10.222.0.55 () {58 vars in 1154 bytes} [Wed Jun 8 13:46:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:46.818354 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-66b1532d-47eb-4ead-a6fe-8648cbcc1b98 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:46.819147 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-66b1532d-47eb-4ead-a6fe-8648cbcc1b98 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:46.833998 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-66b1532d-47eb-4ead-a6fe-8648cbcc1b98 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:46.837005 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-66b1532d-47eb-4ead-a6fe-8648cbcc1b98 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:46.838958 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-66b1532d-47eb-4ead-a6fe-8648cbcc1b98 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:46.842208 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-66b1532d-47eb-4ead-a6fe-8648cbcc1b98 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:47.129439 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-66b1532d-47eb-4ead-a6fe-8648cbcc1b98 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:47.142987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-66b1532d-47eb-4ead-a6fe-8648cbcc1b98 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1284 microversion: 2.1 time: 0.328836 Jun 08 13:46:47.145071 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 13/25] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:46 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:48.170703 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e8db558a-fbc1-4da9-8220-c866aa111f0e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:48.171996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e8db558a-fbc1-4da9-8220-c866aa111f0e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:48.193644 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e8db558a-fbc1-4da9-8220-c866aa111f0e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:48.194305 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e8db558a-fbc1-4da9-8220-c866aa111f0e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:48.197604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e8db558a-fbc1-4da9-8220-c866aa111f0e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:48.197934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e8db558a-fbc1-4da9-8220-c866aa111f0e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:48.229077 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-88de5449-8d55-4551-9601-5e25702a8ee9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'create', calling method: .version_select at 0x7fe28a282e50>, body: {"keypair": {"name": "tempest-keypair-1691173796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmV0MVdlFXegVU6g8iQejii2r5TusYLk7AGAUng/Ir9yEkL6EP35SbnlkQdD2tzAC6GmWLdWUN4RoGF/po1cC5CGqn6N424fkhNBC19jba9OwytILZ1BO6067is6xNxmw=="}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:46:48.288418 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-88de5449-8d55-4551-9601-5e25702a8ee9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Getting quotas for project 87c115dc845a497292c12e2980e9f77b. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:46:48.303014 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-88de5449-8d55-4551-9601-5e25702a8ee9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Getting quotas for user cc438414709747599fba278ea9b6fecf and project 87c115dc845a497292c12e2980e9f77b. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:46:48.473296 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-88de5449-8d55-4551-9601-5e25702a8ee9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.542492 Jun 08 13:46:48.473922 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 13/26] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 13:46:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:46:48.669865 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e8db558a-fbc1-4da9-8220-c866aa111f0e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:48.686139 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e8db558a-fbc1-4da9-8220-c866aa111f0e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1272 microversion: 2.1 time: 0.519154 Jun 08 13:46:48.686737 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 14/27] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:48 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1272 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:46:49.709102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-227007d5-7c22-4c97-87e2-4a34182b4e75 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:49.711119 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-227007d5-7c22-4c97-87e2-4a34182b4e75 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:49.748460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-227007d5-7c22-4c97-87e2-4a34182b4e75 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:49.752941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-227007d5-7c22-4c97-87e2-4a34182b4e75 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:49.752941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-227007d5-7c22-4c97-87e2-4a34182b4e75 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:49.752941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-227007d5-7c22-4c97-87e2-4a34182b4e75 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:50.548809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:51.025166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-227007d5-7c22-4c97-87e2-4a34182b4e75 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:51.036121 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-227007d5-7c22-4c97-87e2-4a34182b4e75 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 1.333811 Jun 08 13:46:51.068589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 14/28] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:49 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:52.075887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e1abdca4-f17e-412d-b86e-943f83302bd6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:52.083715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e1abdca4-f17e-412d-b86e-943f83302bd6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:52.087567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:46:52.092442 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1abdca4-f17e-412d-b86e-943f83302bd6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:52.094398 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1abdca4-f17e-412d-b86e-943f83302bd6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:52.099122 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1abdca4-f17e-412d-b86e-943f83302bd6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:52.099882 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1abdca4-f17e-412d-b86e-943f83302bd6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:53.832707 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e1abdca4-f17e-412d-b86e-943f83302bd6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:53.857189 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e1abdca4-f17e-412d-b86e-943f83302bd6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 1.783569 Jun 08 13:46:53.863009 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 15/29] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:52 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:54.830066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b876da50-7ce2-4a49-9473-af3d8b6ded15 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'create', calling method: .version_select at 0x7fe28a298ee0>, body: {"keypair": {"name": "tempest-keypair-789774920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7HE3HsAG6hT6lMoIer2RFotWOw2dnwIwHv4q691QzGmHw1Y5/L4mbpyVO4mXuoupXwCdBpZEZIlzCnc9EM46we3TVfT9y4yHPiiJ3Eree4344KK03iMpykAK3ycLEhg=="}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:46:54.880556 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-16a28a77-5db1-41ad-af79-e7e2be6511a1 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:54.881179 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-16a28a77-5db1-41ad-af79-e7e2be6511a1 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:54.882566 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-b876da50-7ce2-4a49-9473-af3d8b6ded15 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Getting quotas for project d0cc65fa99694daa81878db0200bdb4b. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:46:54.893508 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16a28a77-5db1-41ad-af79-e7e2be6511a1 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:54.894021 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16a28a77-5db1-41ad-af79-e7e2be6511a1 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:54.894841 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16a28a77-5db1-41ad-af79-e7e2be6511a1 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:54.895280 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16a28a77-5db1-41ad-af79-e7e2be6511a1 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:54.896125 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-b876da50-7ce2-4a49-9473-af3d8b6ded15 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Getting quotas for user 1b970b89c20645d98da510e03a915fd5 and project d0cc65fa99694daa81878db0200bdb4b. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:46:55.064429 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b876da50-7ce2-4a49-9473-af3d8b6ded15 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.517889 Jun 08 13:46:55.071314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 15/30] 10.222.0.55 () {62 vars in 1199 bytes} [Wed Jun 8 13:46:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 520 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 08 13:46:55.811000 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-16a28a77-5db1-41ad-af79-e7e2be6511a1 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:55.820013 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-16a28a77-5db1-41ad-af79-e7e2be6511a1 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.944927 Jun 08 13:46:55.833094 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 16/31] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:54 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:56.837508 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-569ba29d-cbed-4333-bbfb-77258caed05d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:56.838390 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-569ba29d-cbed-4333-bbfb-77258caed05d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:56.847325 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-569ba29d-cbed-4333-bbfb-77258caed05d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:56.848237 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-569ba29d-cbed-4333-bbfb-77258caed05d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:56.849396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-569ba29d-cbed-4333-bbfb-77258caed05d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:56.850027 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-569ba29d-cbed-4333-bbfb-77258caed05d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:57.212500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-83191ceb-4588-4178-af2c-df5aa6524bf9 req-8aeae79c-2ed5-4c14-96b6-a64d5e62151e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee648927-27a4-4ca6-a341-22a82e9e54a2", "tag": "07b64f58-2f27-4e2b-b1cb-fd9712202bf8"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:46:57.233011 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-83191ceb-4588-4178-af2c-df5aa6524bf9 req-8aeae79c-2ed5-4c14-96b6-a64d5e62151e service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:57.236439 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-83191ceb-4588-4178-af2c-df5aa6524bf9 req-8aeae79c-2ed5-4c14-96b6-a64d5e62151e service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:57.293534 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-83191ceb-4588-4178-af2c-df5aa6524bf9 req-8aeae79c-2ed5-4c14-96b6-a64d5e62151e service nova] Creating event network-changed:07b64f58-2f27-4e2b-b1cb-fd9712202bf8 for instance ee648927-27a4-4ca6-a341-22a82e9e54a2 on hv-cinder-81914 Jun 08 13:46:57.295314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-83191ceb-4588-4178-af2c-df5aa6524bf9 req-8aeae79c-2ed5-4c14-96b6-a64d5e62151e service nova] Acquired lock "compute-rpcapi-router" {{(pid=124629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 08 13:46:57.297653 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8fad2f4b-930f-4dcb-aa4d-82c08c27c271 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:57.301929 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8fad2f4b-930f-4dcb-aa4d-82c08c27c271 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:57.303092 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8fad2f4b-930f-4dcb-aa4d-82c08c27c271 None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:57.306686 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8fad2f4b-930f-4dcb-aa4d-82c08c27c271 None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:57.325276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.compute.rpcapi [None req-8fad2f4b-930f-4dcb-aa4d-82c08c27c271 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 08 13:46:57.326105 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8fad2f4b-930f-4dcb-aa4d-82c08c27c271 None None] Releasing lock "compute-rpcapi-router" {{(pid=124629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 08 13:46:57.328596 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-569ba29d-cbed-4333-bbfb-77258caed05d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:57.341151 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-569ba29d-cbed-4333-bbfb-77258caed05d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.508668 Jun 08 13:46:57.342074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 16/32] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:56 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:46:57.393874 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8fad2f4b-930f-4dcb-aa4d-82c08c27c271 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372314 Jun 08 13:46:57.395015 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 17/33] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:46:57.692399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1082153472", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42d99904-a8b4-4285-872c-5a43c79568a6"}], "security_groups": [{"name": "tempest-securitygroup--41503664"}], "key_name": "tempest-keypair-1691173796", "user_data": "}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:46:58.361073 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-495b5987-e649-4d4c-a060-c5656c5b0c2b tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:46:58.362078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-495b5987-e649-4d4c-a060-c5656c5b0c2b tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:46:58.379069 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-495b5987-e649-4d4c-a060-c5656c5b0c2b tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:58.384789 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-495b5987-e649-4d4c-a060-c5656c5b0c2b tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:58.384789 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-495b5987-e649-4d4c-a060-c5656c5b0c2b tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:46:58.384789 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-495b5987-e649-4d4c-a060-c5656c5b0c2b tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:46:58.501182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] validate_networks() for [('42d99904-a8b4-4285-872c-5a43c79568a6', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:46:59.073338 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-495b5987-e649-4d4c-a060-c5656c5b0c2b tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:46:59.081290 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-495b5987-e649-4d4c-a060-c5656c5b0c2b tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.724838 Jun 08 13:46:59.085168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 18/34] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:46:58 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:00.103211 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-37f32758-2375-485c-82c1-f9093b0886de tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:00.105031 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-37f32758-2375-485c-82c1-f9093b0886de tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:00.123382 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37f32758-2375-485c-82c1-f9093b0886de tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:00.125076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37f32758-2375-485c-82c1-f9093b0886de tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:00.126866 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37f32758-2375-485c-82c1-f9093b0886de tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:00.131414 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37f32758-2375-485c-82c1-f9093b0886de tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:01.594573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:47:01.599129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:47:01.599129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:47:01.599129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:47:01.599129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:47:01.620217 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:01.623699 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:01.623863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:01.624270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:01.739171 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Getting quotas for project 87c115dc845a497292c12e2980e9f77b. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:47:01.755961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Getting quotas for user cc438414709747599fba278ea9b6fecf and project 87c115dc845a497292c12e2980e9f77b. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:47:01.809696 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:47:01.841302 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:47:01.859403 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-37f32758-2375-485c-82c1-f9093b0886de tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:01.877553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-37f32758-2375-485c-82c1-f9093b0886de tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 1.779586 Jun 08 13:47:01.881153 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 19/35] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:00 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:02.022457 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1058575495", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12800c86-d5ba-481d-a55e-8c6ac82045b0"}], "security_groups": [{"name": "tempest-securitygroup--102123834"}], "key_name": "tempest-keypair-789774920", "user_data": "}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:02.195977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0928526c-a4dd-4dc0-afeb-f034dfe48e6c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 4.506447 Jun 08 13:47:02.201487 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 17/36] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:46:57 2022] POST /compute/v2.1/servers => generated 400 bytes in 4515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:47:02.224384 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c0517f2f-9e7b-4094-b276-dc79d05667c3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:02.230597 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c0517f2f-9e7b-4094-b276-dc79d05667c3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:02.938347 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c0517f2f-9e7b-4094-b276-dc79d05667c3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:02.973132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c0517f2f-9e7b-4094-b276-dc79d05667c3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1238 microversion: 2.1 time: 0.763095 Jun 08 13:47:02.988141 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 18/37] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:02 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1238 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:02.999329 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] validate_networks() for [('12800c86-d5ba-481d-a55e-8c6ac82045b0', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:47:03.326305 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-651047387", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:03.435006 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] validate_networks() for [('ae8a0e1e-0700-4e0e-8372-c30751bbef6f', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:47:04.309190 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:47:04.309884 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:47:04.310313 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:47:04.310941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:47:04.311643 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:47:04.325238 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:04.332209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:04.333441 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:04.334087 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:04.371176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Getting quotas for project 9abd79bc99784c3f81991d1cae37a074. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:47:04.376761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Getting quotas for user 85e0d647620a407cbe03d83c86111f3d and project 9abd79bc99784c3f81991d1cae37a074. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:47:04.390937 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:47:04.393779 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:47:04.415569 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:47:04.416341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:47:04.416536 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:47:04.416946 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:47:04.417356 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:47:04.452932 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:04.453405 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:04.454258 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:04.454701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:04.519648 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Getting quotas for project d0cc65fa99694daa81878db0200bdb4b. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:47:04.533338 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Getting quotas for user 1b970b89c20645d98da510e03a915fd5 and project d0cc65fa99694daa81878db0200bdb4b. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:47:04.548659 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:47:04.553329 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:47:04.562244 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8d488755-1d02-482c-8546-cf21d93dd962 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.572305 Jun 08 13:47:04.562914 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 19/38] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:47:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:47:04.610478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-709d6d38-b8ab-4b04-a389-34a99b36fe0a tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:04.611333 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-709d6d38-b8ab-4b04-a389-34a99b36fe0a tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:04.631094 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-709d6d38-b8ab-4b04-a389-34a99b36fe0a tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:04.632031 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-709d6d38-b8ab-4b04-a389-34a99b36fe0a tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:04.633249 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-709d6d38-b8ab-4b04-a389-34a99b36fe0a tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:04.634071 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-709d6d38-b8ab-4b04-a389-34a99b36fe0a tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:04.760605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-577fe5e6-084c-438f-818c-2b78a3ed3e2f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.745659 Jun 08 13:47:04.762618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 20/39] 10.222.0.55 () {62 vars in 1187 bytes} [Wed Jun 8 13:47:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2748 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 08 13:47:04.777941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fef26a65-13a8-42f0-8805-8e797ba376a9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:04.782887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fef26a65-13a8-42f0-8805-8e797ba376a9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:04.807489 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fef26a65-13a8-42f0-8805-8e797ba376a9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:04.811045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fef26a65-13a8-42f0-8805-8e797ba376a9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:04.825384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fef26a65-13a8-42f0-8805-8e797ba376a9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:04.828256 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fef26a65-13a8-42f0-8805-8e797ba376a9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:05.005398 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-fef26a65-13a8-42f0-8805-8e797ba376a9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:05.018135 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fef26a65-13a8-42f0-8805-8e797ba376a9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1242 microversion: 2.1 time: 0.251944 Jun 08 13:47:05.019307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 21/40] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:04 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1242 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:05.030971 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9a6dc9e8-e390-4141-bfc3-c5e5ae46778e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:05.031939 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9a6dc9e8-e390-4141-bfc3-c5e5ae46778e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:05.041612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-709d6d38-b8ab-4b04-a389-34a99b36fe0a tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:05.042271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-709d6d38-b8ab-4b04-a389-34a99b36fe0a tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.478261 Jun 08 13:47:05.042819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 20/41] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:04 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:05.048405 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0c155b7a-528f-4a65-8ad4-1c2de7a77f32 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:05.050873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0c155b7a-528f-4a65-8ad4-1c2de7a77f32 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:05.132628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9a6dc9e8-e390-4141-bfc3-c5e5ae46778e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:05.139662 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9a6dc9e8-e390-4141-bfc3-c5e5ae46778e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1221 microversion: 2.1 time: 0.118183 Jun 08 13:47:05.144114 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 22/42] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:05 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:05.149222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0c155b7a-528f-4a65-8ad4-1c2de7a77f32 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:05.163474 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0c155b7a-528f-4a65-8ad4-1c2de7a77f32 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:05.165522 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0c155b7a-528f-4a65-8ad4-1c2de7a77f32 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:05.166886 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0c155b7a-528f-4a65-8ad4-1c2de7a77f32 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1281 microversion: 2.20 time: 0.123126 Jun 08 13:47:05.167456 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 21/43] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:05 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:05.286122 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-922339342", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:05.354961 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] validate_networks() for [('ae8a0e1e-0700-4e0e-8372-c30751bbef6f', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:47:06.119746 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:47:06.119746 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:47:06.119746 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:47:06.119746 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:47:06.119746 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:47:06.121236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:06.121236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:06.121236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:06.121236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:06.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:06.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=55 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:06.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Getting quotas for project 9abd79bc99784c3f81991d1cae37a074. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:47:06.122413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-803215fb-7645-489d-bd89-6f7df8d68906 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:06.122413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-803215fb-7645-489d-bd89-6f7df8d68906 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:06.123477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Getting quotas for user 85e0d647620a407cbe03d83c86111f3d and project 9abd79bc99784c3f81991d1cae37a074. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:47:06.124294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-803215fb-7645-489d-bd89-6f7df8d68906 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:06.124294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-803215fb-7645-489d-bd89-6f7df8d68906 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:06.124294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-803215fb-7645-489d-bd89-6f7df8d68906 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:06.124294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-803215fb-7645-489d-bd89-6f7df8d68906 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:06.125016 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:47:06.125016 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:47:06.128643 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-803215fb-7645-489d-bd89-6f7df8d68906 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:06.138102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-803215fb-7645-489d-bd89-6f7df8d68906 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1242 microversion: 2.1 time: 0.105182 Jun 08 13:47:06.170516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 22/44] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:06 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:06.170516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f4763c0d-9e3f-46b6-9a72-761e241e3633 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:06.170516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f4763c0d-9e3f-46b6-9a72-761e241e3633 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:06.170516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:06.170516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f4763c0d-9e3f-46b6-9a72-761e241e3633 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:06.170933 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f4763c0d-9e3f-46b6-9a72-761e241e3633 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:06.170933 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f4763c0d-9e3f-46b6-9a72-761e241e3633 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:06.170933 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f4763c0d-9e3f-46b6-9a72-761e241e3633 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:06.354900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f4763c0d-9e3f-46b6-9a72-761e241e3633 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:06.362935 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f4763c0d-9e3f-46b6-9a72-761e241e3633 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.211143 Jun 08 13:47:06.374795 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 23/45] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:06 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:06.380807 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d999a119-2391-4084-a40b-cfce086d9183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:06.381830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d999a119-2391-4084-a40b-cfce086d9183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:06.719315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d999a119-2391-4084-a40b-cfce086d9183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:06.719315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d999a119-2391-4084-a40b-cfce086d9183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:06.719644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d999a119-2391-4084-a40b-cfce086d9183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:06.719644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d999a119-2391-4084-a40b-cfce086d9183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1281 microversion: 2.20 time: 0.316644 Jun 08 13:47:06.719644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:06 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1281 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:07.156620 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-db4405cd-3064-4d07-88e8-63eb02efa1e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:07.157291 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-db4405cd-3064-4d07-88e8-63eb02efa1e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:07.164353 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-db4405cd-3064-4d07-88e8-63eb02efa1e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:07.164815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-db4405cd-3064-4d07-88e8-63eb02efa1e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:07.165623 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-db4405cd-3064-4d07-88e8-63eb02efa1e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:07.166090 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-db4405cd-3064-4d07-88e8-63eb02efa1e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:07.228739 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-db4405cd-3064-4d07-88e8-63eb02efa1e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:07.236320 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-db4405cd-3064-4d07-88e8-63eb02efa1e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1242 microversion: 2.1 time: 0.083539 Jun 08 13:47:07.236893 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 25/47] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:07 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:07.387538 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d6eb7a27-570d-4b00-b5a0-2dca53422f7c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:07.389510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d6eb7a27-570d-4b00-b5a0-2dca53422f7c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:07.389684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d20db95f-941a-4f18-badc-201e2786d940 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.114572 Jun 08 13:47:07.397931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 23/48] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:47:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 08 13:47:07.408010 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1a9fa8e2-e47b-4f4e-9d50-3c880eff7194 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:07.408660 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1a9fa8e2-e47b-4f4e-9d50-3c880eff7194 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:07.420360 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d6eb7a27-570d-4b00-b5a0-2dca53422f7c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:07.422089 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d6eb7a27-570d-4b00-b5a0-2dca53422f7c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:07.426468 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d6eb7a27-570d-4b00-b5a0-2dca53422f7c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:07.426468 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d6eb7a27-570d-4b00-b5a0-2dca53422f7c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:07.438894 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=44 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:07.488670 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1a9fa8e2-e47b-4f4e-9d50-3c880eff7194 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:07.502574 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1a9fa8e2-e47b-4f4e-9d50-3c880eff7194 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1221 microversion: 2.1 time: 0.095869 Jun 08 13:47:07.503756 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 24/49] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:07 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:07.721935 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d6eb7a27-570d-4b00-b5a0-2dca53422f7c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:07.729455 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d6eb7a27-570d-4b00-b5a0-2dca53422f7c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.351592 Jun 08 13:47:07.730027 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 26/50] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:07 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:07.746667 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:07.750500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:07.753705 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:07.754156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:07.754930 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:07.755369 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:07.824456 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:07.832554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:07.835290 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:07.836492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-83e2a165-a4ff-48c2-8545-e36568df4f02 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1285 microversion: 2.20 time: 0.093965 Jun 08 13:47:07.837071 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:07 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:08.253736 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-76f06dae-40b9-4679-96c6-7423c348e692 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:08.254364 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-76f06dae-40b9-4679-96c6-7423c348e692 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:08.261298 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-76f06dae-40b9-4679-96c6-7423c348e692 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:08.261760 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-76f06dae-40b9-4679-96c6-7423c348e692 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:08.262533 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-76f06dae-40b9-4679-96c6-7423c348e692 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:08.262975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-76f06dae-40b9-4679-96c6-7423c348e692 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:08.329111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-76f06dae-40b9-4679-96c6-7423c348e692 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:08.351612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-76f06dae-40b9-4679-96c6-7423c348e692 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1290 microversion: 2.1 time: 0.101562 Jun 08 13:47:08.352696 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 27/52] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:08 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:08.520459 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-29c76622-dec9-427c-becf-40238dbc35aa tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:08.521175 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-29c76622-dec9-427c-becf-40238dbc35aa tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:08.528785 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29c76622-dec9-427c-becf-40238dbc35aa tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:08.529452 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29c76622-dec9-427c-becf-40238dbc35aa tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:08.530229 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29c76622-dec9-427c-becf-40238dbc35aa tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:08.530812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29c76622-dec9-427c-becf-40238dbc35aa tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:08.621178 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-29c76622-dec9-427c-becf-40238dbc35aa tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:08.629332 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-29c76622-dec9-427c-becf-40238dbc35aa tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1225 microversion: 2.1 time: 0.113527 Jun 08 13:47:08.630898 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 26/53] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:08 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:08.747078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-77eef6c9-7181-4d33-a1f7-1a1512e40e29 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:08.747702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-77eef6c9-7181-4d33-a1f7-1a1512e40e29 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:08.754311 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-77eef6c9-7181-4d33-a1f7-1a1512e40e29 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:08.754879 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-77eef6c9-7181-4d33-a1f7-1a1512e40e29 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:08.755654 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-77eef6c9-7181-4d33-a1f7-1a1512e40e29 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:08.756124 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-77eef6c9-7181-4d33-a1f7-1a1512e40e29 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:08.855718 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:08.856661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:08.863508 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:08.864339 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:08.865519 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:08.867141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:08.904806 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-77eef6c9-7181-4d33-a1f7-1a1512e40e29 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:08.915042 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-77eef6c9-7181-4d33-a1f7-1a1512e40e29 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.171798 Jun 08 13:47:08.916977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 28/54] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:08 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:08.949064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:08.958628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:08.962974 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:08.962974 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f30ba104-0e61-42e7-afcb-100ccc3ed618 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1285 microversion: 2.20 time: 0.111366 Jun 08 13:47:08.963673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 27/55] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:08 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:47:09.374572 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a5a3b686-80c8-4eb7-813a-36930605f6f3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:09.375218 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a5a3b686-80c8-4eb7-813a-36930605f6f3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:09.381862 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5a3b686-80c8-4eb7-813a-36930605f6f3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:09.382523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5a3b686-80c8-4eb7-813a-36930605f6f3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:09.383291 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5a3b686-80c8-4eb7-813a-36930605f6f3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:09.383726 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5a3b686-80c8-4eb7-813a-36930605f6f3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:09.455656 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a5a3b686-80c8-4eb7-813a-36930605f6f3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:09.464349 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a5a3b686-80c8-4eb7-813a-36930605f6f3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1290 microversion: 2.1 time: 0.093705 Jun 08 13:47:09.465712 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 29/56] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:09 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:09.648562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-03150bc9-a724-4eba-991c-e3623a2a6c63 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:09.648991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-03150bc9-a724-4eba-991c-e3623a2a6c63 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:09.654883 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-03150bc9-a724-4eba-991c-e3623a2a6c63 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:09.655531 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-03150bc9-a724-4eba-991c-e3623a2a6c63 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:09.656326 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-03150bc9-a724-4eba-991c-e3623a2a6c63 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:09.656761 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-03150bc9-a724-4eba-991c-e3623a2a6c63 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:09.756277 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-03150bc9-a724-4eba-991c-e3623a2a6c63 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:09.789705 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-03150bc9-a724-4eba-991c-e3623a2a6c63 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1273 microversion: 2.1 time: 0.146710 Jun 08 13:47:09.790301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 28/57] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:09 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:09.936831 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7a34820b-7e10-4a6a-9010-aea20f639037 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:09.936831 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7a34820b-7e10-4a6a-9010-aea20f639037 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:09.944091 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a34820b-7e10-4a6a-9010-aea20f639037 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:09.944989 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a34820b-7e10-4a6a-9010-aea20f639037 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:09.945869 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a34820b-7e10-4a6a-9010-aea20f639037 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:09.946419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a34820b-7e10-4a6a-9010-aea20f639037 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:09.995470 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:09.999497 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:10.017845 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:10.019009 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:10.021769 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:10.021769 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:10.133053 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:10.144540 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:10.146248 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:10.151640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-74468b9f-1e5d-49b2-9b2a-34597681c5ab tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1333 microversion: 2.20 time: 0.168866 Jun 08 13:47:10.151640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 29/58] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:09 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1333 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:47:10.225778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7a34820b-7e10-4a6a-9010-aea20f639037 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:10.233914 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7a34820b-7e10-4a6a-9010-aea20f639037 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.305388 Jun 08 13:47:10.234509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 30/59] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:09 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:10.482914 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-00f86cb0-c25a-419f-b62c-fbb847bc6407 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:10.483825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-00f86cb0-c25a-419f-b62c-fbb847bc6407 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:10.496104 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-00f86cb0-c25a-419f-b62c-fbb847bc6407 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:10.496628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-00f86cb0-c25a-419f-b62c-fbb847bc6407 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:10.497579 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-00f86cb0-c25a-419f-b62c-fbb847bc6407 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:10.504203 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-00f86cb0-c25a-419f-b62c-fbb847bc6407 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:10.810697 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-49b529b8-78a3-45cc-800d-d31dbb85b405 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:10.811964 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-49b529b8-78a3-45cc-800d-d31dbb85b405 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:10.812225 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-00f86cb0-c25a-419f-b62c-fbb847bc6407 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:10.825276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-00f86cb0-c25a-419f-b62c-fbb847bc6407 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1296 microversion: 2.1 time: 0.346089 Jun 08 13:47:10.826479 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-49b529b8-78a3-45cc-800d-d31dbb85b405 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:10.826945 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-49b529b8-78a3-45cc-800d-d31dbb85b405 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:10.827389 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 30/60] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:10 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1296 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:10.828213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-49b529b8-78a3-45cc-800d-d31dbb85b405 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:10.828213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-49b529b8-78a3-45cc-800d-d31dbb85b405 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:10.999197 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-49b529b8-78a3-45cc-800d-d31dbb85b405 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:11.011476 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-49b529b8-78a3-45cc-800d-d31dbb85b405 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1281 microversion: 2.1 time: 0.207133 Jun 08 13:47:11.012761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 31/61] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:10 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1281 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:11.168129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:11.170309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:11.204852 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:11.205246 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:11.211553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:11.212008 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:11.252342 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-03becc2f-27b0-42c5-9bca-9f21f172f390 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:11.252976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-03becc2f-27b0-42c5-9bca-9f21f172f390 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:11.261388 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-03becc2f-27b0-42c5-9bca-9f21f172f390 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:11.261848 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-03becc2f-27b0-42c5-9bca-9f21f172f390 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:11.262637 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-03becc2f-27b0-42c5-9bca-9f21f172f390 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:11.263079 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-03becc2f-27b0-42c5-9bca-9f21f172f390 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:11.333041 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:11.342521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:11.349304 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:11.352562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-72ab9291-efdd-438e-9fe3-9988745ca077 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1341 microversion: 2.20 time: 0.190449 Jun 08 13:47:11.364222 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 31/62] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:11 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1341 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:11.528383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-03becc2f-27b0-42c5-9bca-9f21f172f390 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:11.535992 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-03becc2f-27b0-42c5-9bca-9f21f172f390 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.288824 Jun 08 13:47:11.549806 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 32/63] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:11 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:11.845199 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-84998f44-dad9-4f8d-9641-9a612408945a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:11.845907 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-84998f44-dad9-4f8d-9641-9a612408945a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:11.853427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84998f44-dad9-4f8d-9641-9a612408945a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:11.853961 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84998f44-dad9-4f8d-9641-9a612408945a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:11.854744 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84998f44-dad9-4f8d-9641-9a612408945a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:11.855386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84998f44-dad9-4f8d-9641-9a612408945a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:11.998770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-84998f44-dad9-4f8d-9641-9a612408945a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:12.005309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-84998f44-dad9-4f8d-9641-9a612408945a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.162767 Jun 08 13:47:12.018303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 32/64] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:11 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:12.032388 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3ffd6ee7-cf15-4b39-b370-f358c16e2425 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:12.032388 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3ffd6ee7-cf15-4b39-b370-f358c16e2425 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:12.073728 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3ffd6ee7-cf15-4b39-b370-f358c16e2425 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:12.075108 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3ffd6ee7-cf15-4b39-b370-f358c16e2425 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:12.076640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3ffd6ee7-cf15-4b39-b370-f358c16e2425 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:12.083517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3ffd6ee7-cf15-4b39-b370-f358c16e2425 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:12.251685 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3ffd6ee7-cf15-4b39-b370-f358c16e2425 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:12.259279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3ffd6ee7-cf15-4b39-b370-f358c16e2425 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.233614 Jun 08 13:47:12.259860 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 33/65] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:12 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:12.374765 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:12.375433 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:12.382598 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:12.386537 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:12.386537 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:12.386537 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:12.453131 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:12.462595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:12.464149 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:12.465272 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d7718ab5-4197-48d9-bd25-0cca5d01eb0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1351 microversion: 2.20 time: 0.094407 Jun 08 13:47:12.465842 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 33/66] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:12 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:47:12.556277 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c2cb230d-89d0-49fe-bfb2-6128b3145d11 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:12.556891 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c2cb230d-89d0-49fe-bfb2-6128b3145d11 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:12.562790 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c2cb230d-89d0-49fe-bfb2-6128b3145d11 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:12.563236 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c2cb230d-89d0-49fe-bfb2-6128b3145d11 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:12.563991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c2cb230d-89d0-49fe-bfb2-6128b3145d11 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:12.564450 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c2cb230d-89d0-49fe-bfb2-6128b3145d11 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:12.695273 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c2cb230d-89d0-49fe-bfb2-6128b3145d11 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:12.702700 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c2cb230d-89d0-49fe-bfb2-6128b3145d11 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.150243 Jun 08 13:47:12.703271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 34/67] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:12 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:13.029770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7701c402-4253-4240-95f0-b2d5a3e344f9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:13.029770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7701c402-4253-4240-95f0-b2d5a3e344f9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:13.034915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7701c402-4253-4240-95f0-b2d5a3e344f9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:13.035593 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7701c402-4253-4240-95f0-b2d5a3e344f9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:13.036657 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7701c402-4253-4240-95f0-b2d5a3e344f9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:13.037455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7701c402-4253-4240-95f0-b2d5a3e344f9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:13.195590 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7701c402-4253-4240-95f0-b2d5a3e344f9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:13.207090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7701c402-4253-4240-95f0-b2d5a3e344f9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.185344 Jun 08 13:47:13.207090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 34/68] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:13 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:13.279724 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2056caef-1dc5-4c6a-b48c-8b871e1c4a5f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:13.280567 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2056caef-1dc5-4c6a-b48c-8b871e1c4a5f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:13.286962 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2056caef-1dc5-4c6a-b48c-8b871e1c4a5f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:13.287352 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2056caef-1dc5-4c6a-b48c-8b871e1c4a5f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:13.288158 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2056caef-1dc5-4c6a-b48c-8b871e1c4a5f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:13.288760 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2056caef-1dc5-4c6a-b48c-8b871e1c4a5f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:13.433709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2056caef-1dc5-4c6a-b48c-8b871e1c4a5f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:13.441146 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2056caef-1dc5-4c6a-b48c-8b871e1c4a5f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.167591 Jun 08 13:47:13.441775 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 35/69] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:13 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:13.491511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:13.492369 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:13.504132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:13.504132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:13.504132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:13.504132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:13.565964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:13.575221 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:13.576671 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:13.577771 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-97791f5d-6c47-4bc6-8c9a-2e4ca4b5183b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1351 microversion: 2.20 time: 0.091260 Jun 08 13:47:13.578333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 35/70] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:13 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:13.719392 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f1454c24-2e86-4c43-a300-213c6ad01e74 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:13.720017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f1454c24-2e86-4c43-a300-213c6ad01e74 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:13.727952 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f1454c24-2e86-4c43-a300-213c6ad01e74 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:13.728452 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f1454c24-2e86-4c43-a300-213c6ad01e74 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:13.729233 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f1454c24-2e86-4c43-a300-213c6ad01e74 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:13.729668 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f1454c24-2e86-4c43-a300-213c6ad01e74 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:13.856074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f1454c24-2e86-4c43-a300-213c6ad01e74 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:13.863321 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f1454c24-2e86-4c43-a300-213c6ad01e74 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.147861 Jun 08 13:47:13.863883 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 36/71] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:13 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:14.223031 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a608bb72-ea9a-41f7-8427-f2ec13518be3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:14.224390 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a608bb72-ea9a-41f7-8427-f2ec13518be3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:14.234075 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a608bb72-ea9a-41f7-8427-f2ec13518be3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:14.236163 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a608bb72-ea9a-41f7-8427-f2ec13518be3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:14.241963 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a608bb72-ea9a-41f7-8427-f2ec13518be3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:14.241963 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a608bb72-ea9a-41f7-8427-f2ec13518be3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:14.458629 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-606ac7ac-bbbb-43a6-911d-19af19759711 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:14.459993 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-606ac7ac-bbbb-43a6-911d-19af19759711 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:14.464018 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=4 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:14.485862 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-606ac7ac-bbbb-43a6-911d-19af19759711 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:14.487778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-606ac7ac-bbbb-43a6-911d-19af19759711 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:14.493612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-606ac7ac-bbbb-43a6-911d-19af19759711 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:14.494177 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-606ac7ac-bbbb-43a6-911d-19af19759711 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:14.564988 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a608bb72-ea9a-41f7-8427-f2ec13518be3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:14.576681 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a608bb72-ea9a-41f7-8427-f2ec13518be3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.357377 Jun 08 13:47:14.587791 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 36/72] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:14 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:14.603057 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:14.603731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:14.616788 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:14.617292 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:14.620080 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:14.620674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:14.768679 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:14.777560 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:14.780365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:14.781720 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c476e064-116e-4cf1-bb2f-1d1a81458354 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1339 microversion: 2.20 time: 0.190056 Jun 08 13:47:14.782858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 37/73] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:14 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1339 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:14.863587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-606ac7ac-bbbb-43a6-911d-19af19759711 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:14.880293 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f3576367-c826-49fe-ab3e-f124189df6be tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:14.880905 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f3576367-c826-49fe-ab3e-f124189df6be tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:14.889737 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3576367-c826-49fe-ab3e-f124189df6be tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:14.890283 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3576367-c826-49fe-ab3e-f124189df6be tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:14.890937 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3576367-c826-49fe-ab3e-f124189df6be tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:14.891369 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3576367-c826-49fe-ab3e-f124189df6be tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:14.892121 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-606ac7ac-bbbb-43a6-911d-19af19759711 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.433269 Jun 08 13:47:14.893296 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 37/74] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:14 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:15.091599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f3576367-c826-49fe-ab3e-f124189df6be tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:15.103770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f3576367-c826-49fe-ab3e-f124189df6be tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.226911 Jun 08 13:47:15.116387 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 38/75] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:14 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:15.595236 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3993c31d-12c6-4730-a442-e3072b639d87 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:15.596038 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3993c31d-12c6-4730-a442-e3072b639d87 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:15.606325 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3993c31d-12c6-4730-a442-e3072b639d87 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:15.606772 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3993c31d-12c6-4730-a442-e3072b639d87 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:15.607545 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3993c31d-12c6-4730-a442-e3072b639d87 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:15.607983 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3993c31d-12c6-4730-a442-e3072b639d87 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:15.723065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-28168dff-ff7f-4cd6-861b-73f467d40af3 req-8d94de74-edcf-46c0-af8a-809f4b0fad7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1db0ac6d-b933-4abd-96b8-c1af36e06791", "tag": "38bbf42f-b3f0-44a4-992c-b83e8f85c80a"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:15.746145 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-28168dff-ff7f-4cd6-861b-73f467d40af3 req-8d94de74-edcf-46c0-af8a-809f4b0fad7a service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:15.751002 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-28168dff-ff7f-4cd6-861b-73f467d40af3 req-8d94de74-edcf-46c0-af8a-809f4b0fad7a service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:15.782581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-28168dff-ff7f-4cd6-861b-73f467d40af3 req-8d94de74-edcf-46c0-af8a-809f4b0fad7a service nova] Creating event network-changed:38bbf42f-b3f0-44a4-992c-b83e8f85c80a for instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 on hv-cinder-81914 Jun 08 13:47:15.793053 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-28168dff-ff7f-4cd6-861b-73f467d40af3 req-8d94de74-edcf-46c0-af8a-809f4b0fad7a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074254 Jun 08 13:47:15.796444 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 39/76] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:47:15.820861 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:15.825135 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:15.841236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:15.843094 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:15.844025 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:15.845076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:16.010694 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:16.031046 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3993c31d-12c6-4730-a442-e3072b639d87 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:16.035460 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:16.037885 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:16.041316 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3ff7d9c1-a825-42ce-a90f-5c8790b6d519 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1339 microversion: 2.20 time: 0.238418 Jun 08 13:47:16.041883 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 40/77] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:15 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1339 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:47:16.043504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3993c31d-12c6-4730-a442-e3072b639d87 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.452664 Jun 08 13:47:16.045564 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=6 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:16.048718 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 38/78] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:15 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:16.066075 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a5fc7f28-04db-47b7-a358-1228ca3af28f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:16.067094 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a5fc7f28-04db-47b7-a358-1228ca3af28f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:16.078022 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5fc7f28-04db-47b7-a358-1228ca3af28f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:16.078022 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5fc7f28-04db-47b7-a358-1228ca3af28f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:16.079149 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5fc7f28-04db-47b7-a358-1228ca3af28f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:16.085618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5fc7f28-04db-47b7-a358-1228ca3af28f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:16.122381 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-11d06603-d567-4a9b-99cf-7776c2c99385 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:16.123062 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-11d06603-d567-4a9b-99cf-7776c2c99385 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:16.140896 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11d06603-d567-4a9b-99cf-7776c2c99385 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:16.141786 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11d06603-d567-4a9b-99cf-7776c2c99385 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:16.142909 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11d06603-d567-4a9b-99cf-7776c2c99385 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:16.144948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11d06603-d567-4a9b-99cf-7776c2c99385 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:16.686623 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=36 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:16.774501 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a5fc7f28-04db-47b7-a358-1228ca3af28f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:16.783754 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a5fc7f28-04db-47b7-a358-1228ca3af28f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.738977 Jun 08 13:47:16.792829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 41/79] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:16 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:16.869167 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-11d06603-d567-4a9b-99cf-7776c2c99385 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:16.888563 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-11d06603-d567-4a9b-99cf-7776c2c99385 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.769734 Jun 08 13:47:16.889864 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 39/80] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:16 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:16.929824 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-59d63c58-ee70-450a-8f60-a5cabc0f1eb2 req-6077e8e8-9345-47f5-86ab-8753e2a14981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ff0599-d152-4940-9811-f1187ab922e0", "tag": "a043c6d6-d4b4-4d25-927f-f3ba0a63e491"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:16.941395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-59d63c58-ee70-450a-8f60-a5cabc0f1eb2 req-6077e8e8-9345-47f5-86ab-8753e2a14981 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:16.942169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-59d63c58-ee70-450a-8f60-a5cabc0f1eb2 req-6077e8e8-9345-47f5-86ab-8753e2a14981 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:16.947931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=100 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:16.957663 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-59d63c58-ee70-450a-8f60-a5cabc0f1eb2 req-6077e8e8-9345-47f5-86ab-8753e2a14981 service nova] Creating event network-changed:a043c6d6-d4b4-4d25-927f-f3ba0a63e491 for instance b6ff0599-d152-4940-9811-f1187ab922e0 on hv-cinder-81914 Jun 08 13:47:16.964136 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-59d63c58-ee70-450a-8f60-a5cabc0f1eb2 req-6077e8e8-9345-47f5-86ab-8753e2a14981 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168586 Jun 08 13:47:16.965690 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 42/81] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:47:16.981363 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-b39b31f0-cc9d-4201-8e53-564118528bc2 req-040512c4-2447-42bb-ae37-5df1141ae362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee648927-27a4-4ca6-a341-22a82e9e54a2", "name": "network-vif-plugged", "status": "completed", "tag": "07b64f58-2f27-4e2b-b1cb-fd9712202bf8"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:17.010772 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-b39b31f0-cc9d-4201-8e53-564118528bc2 req-040512c4-2447-42bb-ae37-5df1141ae362 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.011443 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-b39b31f0-cc9d-4201-8e53-564118528bc2 req-040512c4-2447-42bb-ae37-5df1141ae362 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.039474 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-b39b31f0-cc9d-4201-8e53-564118528bc2 req-040512c4-2447-42bb-ae37-5df1141ae362 service nova] Creating event network-vif-plugged:07b64f58-2f27-4e2b-b1cb-fd9712202bf8 for instance ee648927-27a4-4ca6-a341-22a82e9e54a2 on hv-cinder-81914 Jun 08 13:47:17.040652 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-b39b31f0-cc9d-4201-8e53-564118528bc2 req-040512c4-2447-42bb-ae37-5df1141ae362 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 08 13:47:17.042345 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45adaa6b-d211-4b76-904f-1cc4009a8d74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.043189 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45adaa6b-d211-4b76-904f-1cc4009a8d74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.044192 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45adaa6b-d211-4b76-904f-1cc4009a8d74 None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.044670 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45adaa6b-d211-4b76-904f-1cc4009a8d74 None None] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.061073 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-21b47aac-2765-43ea-9f48-b78c52e67045 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:17.061770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-21b47aac-2765-43ea-9f48-b78c52e67045 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:17.063215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.compute.rpcapi [None req-45adaa6b-d211-4b76-904f-1cc4009a8d74 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 08 13:47:17.064699 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45adaa6b-d211-4b76-904f-1cc4009a8d74 None None] Releasing lock "compute-rpcapi-router" {{(pid=124628) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 08 13:47:17.070262 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-21b47aac-2765-43ea-9f48-b78c52e67045 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.071121 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-21b47aac-2765-43ea-9f48-b78c52e67045 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.072477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-21b47aac-2765-43ea-9f48-b78c52e67045 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.073353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-21b47aac-2765-43ea-9f48-b78c52e67045 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.085349 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-45adaa6b-d211-4b76-904f-1cc4009a8d74 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193526 Jun 08 13:47:17.114843 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 40/82] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:47:17.131003 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:17.138813 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:17.144575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.145235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.147530 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.148133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.500396 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=16 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:17.573499 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-21b47aac-2765-43ea-9f48-b78c52e67045 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:17.586805 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-21b47aac-2765-43ea-9f48-b78c52e67045 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.527188 Jun 08 13:47:17.589008 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 43/83] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:17 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:17.755992 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:17.774824 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:17.777024 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:17.778840 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-968916fc-882d-4c65-b39e-c9499ba392db tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.658409 Jun 08 13:47:17.791248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 41/84] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:17 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:17.807582 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fed7456d-4cd5-42e4-93cb-93d5ae737352 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:17.809415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fed7456d-4cd5-42e4-93cb-93d5ae737352 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:17.817974 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fed7456d-4cd5-42e4-93cb-93d5ae737352 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.819857 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fed7456d-4cd5-42e4-93cb-93d5ae737352 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.821884 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fed7456d-4cd5-42e4-93cb-93d5ae737352 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.822599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fed7456d-4cd5-42e4-93cb-93d5ae737352 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.911728 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-546b1985-b072-4baa-86a3-7e3d34dd5407 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:17.913734 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-546b1985-b072-4baa-86a3-7e3d34dd5407 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:17.923193 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-546b1985-b072-4baa-86a3-7e3d34dd5407 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.939891 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-546b1985-b072-4baa-86a3-7e3d34dd5407 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:17.939891 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-546b1985-b072-4baa-86a3-7e3d34dd5407 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:17.939891 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-546b1985-b072-4baa-86a3-7e3d34dd5407 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:18.085394 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-fed7456d-4cd5-42e4-93cb-93d5ae737352 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:18.093209 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fed7456d-4cd5-42e4-93cb-93d5ae737352 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.292372 Jun 08 13:47:18.099235 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 44/85] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:17 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:18.156568 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-546b1985-b072-4baa-86a3-7e3d34dd5407 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:18.165044 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-546b1985-b072-4baa-86a3-7e3d34dd5407 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.260583 Jun 08 13:47:18.165960 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 42/86] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:17 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:18.603185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fe10c10f-0748-4d3c-ac49-5667ba0776f5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:18.603801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fe10c10f-0748-4d3c-ac49-5667ba0776f5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:18.609754 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fe10c10f-0748-4d3c-ac49-5667ba0776f5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:18.610202 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fe10c10f-0748-4d3c-ac49-5667ba0776f5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:18.610961 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fe10c10f-0748-4d3c-ac49-5667ba0776f5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:18.611420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fe10c10f-0748-4d3c-ac49-5667ba0776f5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:18.745551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-fe10c10f-0748-4d3c-ac49-5667ba0776f5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:18.753860 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fe10c10f-0748-4d3c-ac49-5667ba0776f5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.154670 Jun 08 13:47:18.754341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 45/87] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:18 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:18.797808 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:18.798466 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:18.809613 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:18.809613 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:18.809613 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:18.809613 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:18.811347 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=100 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:18.940649 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:18.949408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:18.950955 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:18.952164 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-62e69cc4-071d-48ee-8c1e-5946f1dca3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.158178 Jun 08 13:47:18.952717 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 43/88] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:18 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:19.114974 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a52961a4-f6a5-4bea-9dc4-dc39de91c690 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:19.116605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a52961a4-f6a5-4bea-9dc4-dc39de91c690 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:19.122340 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a52961a4-f6a5-4bea-9dc4-dc39de91c690 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:19.126673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a52961a4-f6a5-4bea-9dc4-dc39de91c690 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:19.126673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a52961a4-f6a5-4bea-9dc4-dc39de91c690 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:19.126673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a52961a4-f6a5-4bea-9dc4-dc39de91c690 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:19.182405 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-552fbdb0-201d-45d4-b651-dd0c621a197d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:19.183086 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-552fbdb0-201d-45d4-b651-dd0c621a197d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:19.190683 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-552fbdb0-201d-45d4-b651-dd0c621a197d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:19.191552 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-552fbdb0-201d-45d4-b651-dd0c621a197d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:19.192760 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-552fbdb0-201d-45d4-b651-dd0c621a197d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:19.193348 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-552fbdb0-201d-45d4-b651-dd0c621a197d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:19.379897 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-552fbdb0-201d-45d4-b651-dd0c621a197d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:19.387809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-552fbdb0-201d-45d4-b651-dd0c621a197d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.210014 Jun 08 13:47:19.398246 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 44/89] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:19 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:19.398246 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-70243f70-5d17-408e-9eaa-975882e58824 req-f14afb5b-6da6-452b-8a4c-6dcf1d44a31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0eac024-11de-495f-81cd-85391caa0e2d", "tag": "10edcea1-58b0-4fcc-a997-70b2f8d25e44"}, {"name": "network-changed", "server_uuid": "ac779098-8aa5-40b8-ae7d-dc4e463f015b", "tag": "a0a7ddb0-7def-4156-9a5b-f3b477a1c311"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:19.402832 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-70243f70-5d17-408e-9eaa-975882e58824 req-f14afb5b-6da6-452b-8a4c-6dcf1d44a31f service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:19.403494 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-70243f70-5d17-408e-9eaa-975882e58824 req-f14afb5b-6da6-452b-8a4c-6dcf1d44a31f service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:19.416721 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-70243f70-5d17-408e-9eaa-975882e58824 req-f14afb5b-6da6-452b-8a4c-6dcf1d44a31f service nova] Creating event network-changed:10edcea1-58b0-4fcc-a997-70b2f8d25e44 for instance b0eac024-11de-495f-81cd-85391caa0e2d on hv-cinder-81914 Jun 08 13:47:19.417234 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-70243f70-5d17-408e-9eaa-975882e58824 req-f14afb5b-6da6-452b-8a4c-6dcf1d44a31f service nova] Creating event network-changed:a0a7ddb0-7def-4156-9a5b-f3b477a1c311 for instance ac779098-8aa5-40b8-ae7d-dc4e463f015b on hv-cinder-81914 Jun 08 13:47:19.423612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-70243f70-5d17-408e-9eaa-975882e58824 req-f14afb5b-6da6-452b-8a4c-6dcf1d44a31f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033832 Jun 08 13:47:19.424250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 45/90] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:47:19.434737 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a52961a4-f6a5-4bea-9dc4-dc39de91c690 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:19.442185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a52961a4-f6a5-4bea-9dc4-dc39de91c690 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.331339 Jun 08 13:47:19.442809 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 46/91] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:19 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:19.774168 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5ea9c9bd-dcba-432a-8dc3-21ec9915b290 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:19.774941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5ea9c9bd-dcba-432a-8dc3-21ec9915b290 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:19.781270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5ea9c9bd-dcba-432a-8dc3-21ec9915b290 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:19.781731 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5ea9c9bd-dcba-432a-8dc3-21ec9915b290 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:19.782502 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5ea9c9bd-dcba-432a-8dc3-21ec9915b290 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:19.782943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5ea9c9bd-dcba-432a-8dc3-21ec9915b290 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:19.914239 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5ea9c9bd-dcba-432a-8dc3-21ec9915b290 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:19.921764 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5ea9c9bd-dcba-432a-8dc3-21ec9915b290 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.152626 Jun 08 13:47:19.922340 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 46/92] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:19 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:19.970227 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:19.970835 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:19.977007 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:19.977456 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:19.978213 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:19.978671 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:20.111452 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:20.121160 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:20.123389 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:20.124572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-14cbda45-a21f-4b79-82e9-88fc19228824 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.158191 Jun 08 13:47:20.125101 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 47/93] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:19 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:20.407847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0d9685ff-551a-4160-b047-dd25f5e84ccb tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:20.408513 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0d9685ff-551a-4160-b047-dd25f5e84ccb tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:20.416428 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d9685ff-551a-4160-b047-dd25f5e84ccb tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:20.416941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d9685ff-551a-4160-b047-dd25f5e84ccb tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:20.418265 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d9685ff-551a-4160-b047-dd25f5e84ccb tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:20.418908 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d9685ff-551a-4160-b047-dd25f5e84ccb tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:20.460926 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b73b9c71-062c-42dd-9ae8-31e57934b029 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:20.461637 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b73b9c71-062c-42dd-9ae8-31e57934b029 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:20.470372 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b73b9c71-062c-42dd-9ae8-31e57934b029 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:20.470838 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b73b9c71-062c-42dd-9ae8-31e57934b029 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:20.471873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b73b9c71-062c-42dd-9ae8-31e57934b029 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:20.472500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b73b9c71-062c-42dd-9ae8-31e57934b029 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:20.613142 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0d9685ff-551a-4160-b047-dd25f5e84ccb tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:20.621017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0d9685ff-551a-4160-b047-dd25f5e84ccb tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.219128 Jun 08 13:47:20.621589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 47/94] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:20 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:20.646354 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b73b9c71-062c-42dd-9ae8-31e57934b029 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:20.656821 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b73b9c71-062c-42dd-9ae8-31e57934b029 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.201576 Jun 08 13:47:20.657111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 48/95] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:20 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:20.938571 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1a61b1cd-fccf-4722-b1bf-b5f7d4bd6bd1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:20.939297 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1a61b1cd-fccf-4722-b1bf-b5f7d4bd6bd1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:20.945983 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a61b1cd-fccf-4722-b1bf-b5f7d4bd6bd1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:20.946439 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a61b1cd-fccf-4722-b1bf-b5f7d4bd6bd1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:20.947201 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a61b1cd-fccf-4722-b1bf-b5f7d4bd6bd1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:20.947663 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a61b1cd-fccf-4722-b1bf-b5f7d4bd6bd1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:21.142794 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:21.143409 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:21.150967 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:21.151442 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:21.152280 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:21.152767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:21.287637 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1a61b1cd-fccf-4722-b1bf-b5f7d4bd6bd1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:21.295491 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1a61b1cd-fccf-4722-b1bf-b5f7d4bd6bd1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.360618 Jun 08 13:47:21.296766 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 48/96] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:20 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:21.331717 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:21.340619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:21.342141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:21.343266 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-30fdcc99-d904-4033-ac42-67a9f4cd8f27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.204403 Jun 08 13:47:21.343831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 49/97] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:21 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:47:21.638091 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-72135acb-c63e-402e-b7da-c9b63ed2406c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:21.638702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-72135acb-c63e-402e-b7da-c9b63ed2406c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:21.644730 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72135acb-c63e-402e-b7da-c9b63ed2406c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:21.645181 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72135acb-c63e-402e-b7da-c9b63ed2406c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:21.645920 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72135acb-c63e-402e-b7da-c9b63ed2406c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:21.646399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72135acb-c63e-402e-b7da-c9b63ed2406c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:21.674530 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fbc1968d-661a-4ffd-b393-428f34b898f8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:21.675820 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fbc1968d-661a-4ffd-b393-428f34b898f8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:21.683389 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fbc1968d-661a-4ffd-b393-428f34b898f8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:21.683919 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fbc1968d-661a-4ffd-b393-428f34b898f8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:21.684901 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fbc1968d-661a-4ffd-b393-428f34b898f8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:21.685345 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fbc1968d-661a-4ffd-b393-428f34b898f8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:21.843299 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-72135acb-c63e-402e-b7da-c9b63ed2406c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:21.852717 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-72135acb-c63e-402e-b7da-c9b63ed2406c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.218421 Jun 08 13:47:21.857070 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 49/98] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:21 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:21.872105 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-fbc1968d-661a-4ffd-b393-428f34b898f8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:21.885064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fbc1968d-661a-4ffd-b393-428f34b898f8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.210202 Jun 08 13:47:21.885064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 50/99] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:21 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:22.313191 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cb17642d-8fda-4232-86bc-d6c01dd377c6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:22.313827 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-cb17642d-8fda-4232-86bc-d6c01dd377c6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:22.320746 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cb17642d-8fda-4232-86bc-d6c01dd377c6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:22.325573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cb17642d-8fda-4232-86bc-d6c01dd377c6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:22.325573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cb17642d-8fda-4232-86bc-d6c01dd377c6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:22.325573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cb17642d-8fda-4232-86bc-d6c01dd377c6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:22.362053 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:22.362668 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:22.373856 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:22.374709 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:22.375685 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:22.376414 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:22.521787 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-cb17642d-8fda-4232-86bc-d6c01dd377c6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:22.529507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-cb17642d-8fda-4232-86bc-d6c01dd377c6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.220176 Jun 08 13:47:22.530719 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 50/100] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:22 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:22.548609 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:22.557139 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:22.560274 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:22.560274 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-10272e4c-30ff-40b8-99cd-3c04a1bfe60c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.201893 Jun 08 13:47:22.560531 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 51/101] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:22 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:22.870808 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1f4e5298-c554-4040-b4b8-951066688ae8 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:22.871426 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1f4e5298-c554-4040-b4b8-951066688ae8 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:22.877565 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1f4e5298-c554-4040-b4b8-951066688ae8 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:22.878016 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1f4e5298-c554-4040-b4b8-951066688ae8 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:22.878783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1f4e5298-c554-4040-b4b8-951066688ae8 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:22.879218 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1f4e5298-c554-4040-b4b8-951066688ae8 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:22.901063 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fda80388-f762-4be3-86da-18086d229ba6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:22.903368 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fda80388-f762-4be3-86da-18086d229ba6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:22.909714 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fda80388-f762-4be3-86da-18086d229ba6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:22.910478 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fda80388-f762-4be3-86da-18086d229ba6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:22.911498 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fda80388-f762-4be3-86da-18086d229ba6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:22.912632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fda80388-f762-4be3-86da-18086d229ba6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:23.094477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1f4e5298-c554-4040-b4b8-951066688ae8 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:23.102076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-fda80388-f762-4be3-86da-18086d229ba6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:23.104204 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1f4e5298-c554-4040-b4b8-951066688ae8 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.237696 Jun 08 13:47:23.104783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 51/102] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:22 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:23.109586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fda80388-f762-4be3-86da-18086d229ba6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.214882 Jun 08 13:47:23.110147 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 52/103] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:22 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:23.546280 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-eecd15b2-5b79-4453-8c3e-eef85d7e26ac tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:23.546896 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-eecd15b2-5b79-4453-8c3e-eef85d7e26ac tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:23.553786 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eecd15b2-5b79-4453-8c3e-eef85d7e26ac tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:23.554337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eecd15b2-5b79-4453-8c3e-eef85d7e26ac tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:23.555148 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eecd15b2-5b79-4453-8c3e-eef85d7e26ac tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:23.555587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eecd15b2-5b79-4453-8c3e-eef85d7e26ac tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:23.578782 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:23.579437 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:23.585331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:23.585791 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:23.586605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:23.587111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:23.755023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-eecd15b2-5b79-4453-8c3e-eef85d7e26ac tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:23.765292 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-eecd15b2-5b79-4453-8c3e-eef85d7e26ac tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.222901 Jun 08 13:47:23.765961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 52/104] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:23 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:23.775296 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:23.785049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:23.786574 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:23.788464 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bf1e62c7-347b-42b6-a262-d4f8b0bd9103 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.213514 Jun 08 13:47:23.789790 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 53/105] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:23 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:47:24.121477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-60f14404-69d1-4e16-bed9-bf0c25f81bf7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:24.122091 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-60f14404-69d1-4e16-bed9-bf0c25f81bf7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:24.125708 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4d76e6e0-677d-461c-802c-b124511cbc5d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:24.126463 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4d76e6e0-677d-461c-802c-b124511cbc5d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:24.128139 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-60f14404-69d1-4e16-bed9-bf0c25f81bf7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:24.128585 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-60f14404-69d1-4e16-bed9-bf0c25f81bf7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:24.131673 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-60f14404-69d1-4e16-bed9-bf0c25f81bf7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:24.131673 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-60f14404-69d1-4e16-bed9-bf0c25f81bf7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:24.133309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4d76e6e0-677d-461c-802c-b124511cbc5d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:24.133765 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4d76e6e0-677d-461c-802c-b124511cbc5d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:24.134541 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4d76e6e0-677d-461c-802c-b124511cbc5d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:24.134980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4d76e6e0-677d-461c-802c-b124511cbc5d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:24.319535 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-60f14404-69d1-4e16-bed9-bf0c25f81bf7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:24.327153 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-60f14404-69d1-4e16-bed9-bf0c25f81bf7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.209715 Jun 08 13:47:24.328460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 53/106] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:24 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:24.330389 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4d76e6e0-677d-461c-802c-b124511cbc5d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:24.338153 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4d76e6e0-677d-461c-802c-b124511cbc5d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.216340 Jun 08 13:47:24.338724 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 54/107] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:24 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:24.781864 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-462633a7-8384-4b2d-820a-766818352b14 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:24.782487 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-462633a7-8384-4b2d-820a-766818352b14 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:24.789532 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-462633a7-8384-4b2d-820a-766818352b14 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:24.789994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-462633a7-8384-4b2d-820a-766818352b14 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:24.790773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-462633a7-8384-4b2d-820a-766818352b14 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:24.791317 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-462633a7-8384-4b2d-820a-766818352b14 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:24.806523 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:24.808480 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:24.817470 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:24.818510 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:24.818980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:24.819424 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:25.000172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-462633a7-8384-4b2d-820a-766818352b14 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:25.010570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-462633a7-8384-4b2d-820a-766818352b14 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.232373 Jun 08 13:47:25.014296 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 54/108] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:24 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:25.016238 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:25.033801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:25.035829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:25.037684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bf01cae7-6a4e-4ac6-af6b-fa4e820086ec tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.234673 Jun 08 13:47:25.038410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 55/109] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:24 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:47:25.346988 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-65bc0026-d104-4d67-a0ae-c3df3956109e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:25.347803 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-65bc0026-d104-4d67-a0ae-c3df3956109e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:25.360851 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-587a2189-b635-45e4-9a40-185714a8c8e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:25.361768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-587a2189-b635-45e4-9a40-185714a8c8e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:25.371024 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-65bc0026-d104-4d67-a0ae-c3df3956109e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:25.374919 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-587a2189-b635-45e4-9a40-185714a8c8e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:25.375959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-65bc0026-d104-4d67-a0ae-c3df3956109e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:25.377730 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-65bc0026-d104-4d67-a0ae-c3df3956109e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:25.378715 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-65bc0026-d104-4d67-a0ae-c3df3956109e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:25.385166 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-587a2189-b635-45e4-9a40-185714a8c8e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:25.386781 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-587a2189-b635-45e4-9a40-185714a8c8e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:25.387774 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-587a2189-b635-45e4-9a40-185714a8c8e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:25.647417 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-587a2189-b635-45e4-9a40-185714a8c8e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:25.654884 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-65bc0026-d104-4d67-a0ae-c3df3956109e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:25.655030 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-587a2189-b635-45e4-9a40-185714a8c8e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.298844 Jun 08 13:47:25.655800 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 56/110] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:25 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:25.662915 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-65bc0026-d104-4d67-a0ae-c3df3956109e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1314 microversion: 2.1 time: 0.321987 Jun 08 13:47:25.663475 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 55/111] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:25 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:26.033970 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1f575e9b-fb5d-421d-bb4d-bbb455fdf066 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:26.034710 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1f575e9b-fb5d-421d-bb4d-bbb455fdf066 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:26.042567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f575e9b-fb5d-421d-bb4d-bbb455fdf066 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:26.043102 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f575e9b-fb5d-421d-bb4d-bbb455fdf066 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:26.043952 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f575e9b-fb5d-421d-bb4d-bbb455fdf066 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:26.044486 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f575e9b-fb5d-421d-bb4d-bbb455fdf066 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:26.055949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:26.056694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:26.070071 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:26.070655 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:26.071518 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:26.072077 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:26.301969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1f575e9b-fb5d-421d-bb4d-bbb455fdf066 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:26.314827 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1f575e9b-fb5d-421d-bb4d-bbb455fdf066 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.284623 Jun 08 13:47:26.316131 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 57/112] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:26 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:26.345900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:26.355692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:26.357263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:26.358386 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5f63f8fb-5b1e-4557-ac2e-1201289b21c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.306673 Jun 08 13:47:26.359405 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 56/113] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:26 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:47:26.671907 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-42d2818d-6149-4cba-86aa-ff3af24c8773 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:26.672552 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-42d2818d-6149-4cba-86aa-ff3af24c8773 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:26.678793 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42d2818d-6149-4cba-86aa-ff3af24c8773 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:26.679533 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42d2818d-6149-4cba-86aa-ff3af24c8773 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:26.679746 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b8271409-4cfe-4eb9-b560-42dd3e57487d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:26.680452 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b8271409-4cfe-4eb9-b560-42dd3e57487d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:26.680549 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42d2818d-6149-4cba-86aa-ff3af24c8773 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:26.681042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42d2818d-6149-4cba-86aa-ff3af24c8773 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:26.688753 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b8271409-4cfe-4eb9-b560-42dd3e57487d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:26.689479 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b8271409-4cfe-4eb9-b560-42dd3e57487d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:26.698353 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b8271409-4cfe-4eb9-b560-42dd3e57487d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:26.698353 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b8271409-4cfe-4eb9-b560-42dd3e57487d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:26.875634 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-42d2818d-6149-4cba-86aa-ff3af24c8773 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:26.884202 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-42d2818d-6149-4cba-86aa-ff3af24c8773 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.215628 Jun 08 13:47:26.892929 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 58/114] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:26 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:26.904303 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b8271409-4cfe-4eb9-b560-42dd3e57487d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:26.913064 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b8271409-4cfe-4eb9-b560-42dd3e57487d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1501 microversion: 2.1 time: 0.238102 Jun 08 13:47:26.913861 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 57/115] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:26 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:27.332722 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5a1e1851-1602-43af-8515-28ab30b35f00 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:27.334309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5a1e1851-1602-43af-8515-28ab30b35f00 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:27.350544 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5a1e1851-1602-43af-8515-28ab30b35f00 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:27.351244 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5a1e1851-1602-43af-8515-28ab30b35f00 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:27.354992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5a1e1851-1602-43af-8515-28ab30b35f00 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:27.355451 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5a1e1851-1602-43af-8515-28ab30b35f00 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:27.378486 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:27.379195 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:27.387607 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=100 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:27.395344 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:27.398002 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:27.408041 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:27.410831 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:27.415017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:27.731061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5a1e1851-1602-43af-8515-28ab30b35f00 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:27.747953 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5a1e1851-1602-43af-8515-28ab30b35f00 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.419608 Jun 08 13:47:27.757060 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 59/116] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:27 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:27.779138 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:27.790271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:27.791965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:27.793331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0d94cd8b-cfb0-414d-870a-a85cd3551dd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.419504 Jun 08 13:47:27.794255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 58/117] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:27 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:47:27.909105 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-38501afd-e841-454e-b872-a57c531dff36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:27.911488 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-38501afd-e841-454e-b872-a57c531dff36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:27.925177 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38501afd-e841-454e-b872-a57c531dff36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:27.925628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38501afd-e841-454e-b872-a57c531dff36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:27.926739 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38501afd-e841-454e-b872-a57c531dff36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:27.928124 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38501afd-e841-454e-b872-a57c531dff36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:28.169434 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-38501afd-e841-454e-b872-a57c531dff36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:28.176964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-38501afd-e841-454e-b872-a57c531dff36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.279671 Jun 08 13:47:28.177486 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 60/118] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:27 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:28.765196 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f507a5b7-9243-419f-a6e3-32221ede7701 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:28.765885 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f507a5b7-9243-419f-a6e3-32221ede7701 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:28.772196 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f507a5b7-9243-419f-a6e3-32221ede7701 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:28.772650 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f507a5b7-9243-419f-a6e3-32221ede7701 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:28.773407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f507a5b7-9243-419f-a6e3-32221ede7701 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:28.773846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f507a5b7-9243-419f-a6e3-32221ede7701 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:28.811330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:28.811948 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:28.818018 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:28.818773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:28.820009 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:28.820567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:28.963610 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f507a5b7-9243-419f-a6e3-32221ede7701 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:28.973647 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f507a5b7-9243-419f-a6e3-32221ede7701 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.212168 Jun 08 13:47:28.974873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 59/119] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:28 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:28.985862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:28.994841 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:28.996407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:28.997567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e7ace91c-521b-48ba-87d3-3632096ba3a9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.190048 Jun 08 13:47:29.007992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 61/120] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:28 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:29.194448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b14ab9ce-e3cb-439e-b723-3799c054c22d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:29.195101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b14ab9ce-e3cb-439e-b723-3799c054c22d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:29.202860 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b14ab9ce-e3cb-439e-b723-3799c054c22d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:29.203324 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b14ab9ce-e3cb-439e-b723-3799c054c22d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:29.204191 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b14ab9ce-e3cb-439e-b723-3799c054c22d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:29.204625 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b14ab9ce-e3cb-439e-b723-3799c054c22d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:29.224663 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=100 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:29.420080 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b14ab9ce-e3cb-439e-b723-3799c054c22d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:29.428871 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b14ab9ce-e3cb-439e-b723-3799c054c22d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.238589 Jun 08 13:47:29.429461 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 60/121] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:29 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:29.992384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8dc45728-7201-492a-8937-647b6e4c748f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:29.993005 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8dc45728-7201-492a-8937-647b6e4c748f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:30.000333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8dc45728-7201-492a-8937-647b6e4c748f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:30.000792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8dc45728-7201-492a-8937-647b6e4c748f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:30.001576 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8dc45728-7201-492a-8937-647b6e4c748f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:30.002023 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8dc45728-7201-492a-8937-647b6e4c748f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:30.019812 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:30.019812 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:30.027188 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:30.027687 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:30.028482 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:30.028927 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:30.239931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8dc45728-7201-492a-8937-647b6e4c748f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:30.251091 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8dc45728-7201-492a-8937-647b6e4c748f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.263325 Jun 08 13:47:30.251813 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 62/122] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:29 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:30.257499 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:30.265772 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:30.267337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:30.268486 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6f27993f-48ea-4d41-ab9d-040bc377c32d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.257224 Jun 08 13:47:30.269047 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 61/123] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:30 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:30.451702 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9ecb4a51-d76e-4006-a796-b86b4bb3dc6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:30.451702 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9ecb4a51-d76e-4006-a796-b86b4bb3dc6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:30.460948 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9ecb4a51-d76e-4006-a796-b86b4bb3dc6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:30.461387 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9ecb4a51-d76e-4006-a796-b86b4bb3dc6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:30.462177 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9ecb4a51-d76e-4006-a796-b86b4bb3dc6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:30.462609 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9ecb4a51-d76e-4006-a796-b86b4bb3dc6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:30.830544 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9ecb4a51-d76e-4006-a796-b86b4bb3dc6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:30.839048 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9ecb4a51-d76e-4006-a796-b86b4bb3dc6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.397242 Jun 08 13:47:30.842714 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 63/124] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:30 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:31.186976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-44378da2-fff9-4a8c-8cab-cec6b517d65c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a50fb15f-197a-4e59-b4d2-1bfa03820c65"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:31.188819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-44378da2-fff9-4a8c-8cab-cec6b517d65c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:31.195184 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-44378da2-fff9-4a8c-8cab-cec6b517d65c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:31.195633 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-44378da2-fff9-4a8c-8cab-cec6b517d65c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:31.196700 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-44378da2-fff9-4a8c-8cab-cec6b517d65c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:31.197366 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-44378da2-fff9-4a8c-8cab-cec6b517d65c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:31.270079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c95679e7-31e4-4159-ba7b-a3f5eadf58f4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:31.271998 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c95679e7-31e4-4159-ba7b-a3f5eadf58f4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:31.278288 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c95679e7-31e4-4159-ba7b-a3f5eadf58f4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:31.278863 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c95679e7-31e4-4159-ba7b-a3f5eadf58f4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:31.279631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c95679e7-31e4-4159-ba7b-a3f5eadf58f4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:31.280256 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c95679e7-31e4-4159-ba7b-a3f5eadf58f4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:31.436947 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c95679e7-31e4-4159-ba7b-a3f5eadf58f4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:31.443879 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c95679e7-31e4-4159-ba7b-a3f5eadf58f4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.178850 Jun 08 13:47:31.452266 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 64/125] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:31 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:31.452266 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:31.452266 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:31.457311 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:31.457808 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:31.459164 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:31.459588 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:31.590289 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:31.598379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:31.600591 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:31.601754 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8aa12850-64ed-49f7-932c-f75cac2fde2d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.156009 Jun 08 13:47:31.602322 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 65/126] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:31 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:31.857610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-58036a54-2b91-4531-9841-f01f97abc40b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:31.858468 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-58036a54-2b91-4531-9841-f01f97abc40b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:31.864280 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:31.866063 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-58036a54-2b91-4531-9841-f01f97abc40b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:31.866674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-58036a54-2b91-4531-9841-f01f97abc40b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:31.868248 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-58036a54-2b91-4531-9841-f01f97abc40b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:31.868940 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-58036a54-2b91-4531-9841-f01f97abc40b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:32.032542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-58036a54-2b91-4531-9841-f01f97abc40b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:32.044619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-58036a54-2b91-4531-9841-f01f97abc40b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.191546 Jun 08 13:47:32.051800 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 66/127] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:31 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:32.461646 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-722f62af-ea83-48a1-93cd-ee97dadef46a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:32.462262 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-722f62af-ea83-48a1-93cd-ee97dadef46a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:32.468840 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-722f62af-ea83-48a1-93cd-ee97dadef46a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:32.469299 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-722f62af-ea83-48a1-93cd-ee97dadef46a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:32.470068 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-722f62af-ea83-48a1-93cd-ee97dadef46a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:32.470507 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-722f62af-ea83-48a1-93cd-ee97dadef46a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:32.669290 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-722f62af-ea83-48a1-93cd-ee97dadef46a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:32.676900 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-722f62af-ea83-48a1-93cd-ee97dadef46a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.219440 Jun 08 13:47:32.678776 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 67/128] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:32 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:32.692428 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:32.697844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:32.717547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:32.718285 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:32.721116 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:32.725827 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:32.780639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-44378da2-fff9-4a8c-8cab-cec6b517d65c tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "POST /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.597761 Jun 08 13:47:32.786878 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 62/129] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:47:31 2022] POST /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2/os-volume_attachments => generated 194 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:47:32.860175 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-9eeda5d8-1995-4ccc-b31b-7ed9ba390a0c req-c5bdb2c2-74f5-414d-a47f-e4295f7471a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db0ac6d-b933-4abd-96b8-c1af36e06791", "name": "network-vif-plugged", "status": "completed", "tag": "38bbf42f-b3f0-44a4-992c-b83e8f85c80a"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:32.879075 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-9eeda5d8-1995-4ccc-b31b-7ed9ba390a0c req-c5bdb2c2-74f5-414d-a47f-e4295f7471a6 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:32.881549 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-9eeda5d8-1995-4ccc-b31b-7ed9ba390a0c req-c5bdb2c2-74f5-414d-a47f-e4295f7471a6 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:32.906521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-9eeda5d8-1995-4ccc-b31b-7ed9ba390a0c req-c5bdb2c2-74f5-414d-a47f-e4295f7471a6 service nova] Creating event network-vif-plugged:38bbf42f-b3f0-44a4-992c-b83e8f85c80a for instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 on hv-cinder-81914 Jun 08 13:47:32.914257 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-9eeda5d8-1995-4ccc-b31b-7ed9ba390a0c req-c5bdb2c2-74f5-414d-a47f-e4295f7471a6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058824 Jun 08 13:47:32.915099 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 63/130] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:47:32.997510 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:33.007732 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:33.009443 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:33.010664 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2b4e1560-1fed-4d70-9ec9-e38d1e426bf8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.327706 Jun 08 13:47:33.011320 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 68/131] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:32 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:33.064289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a3dbafa3-75e5-4e5d-8d64-5132d98b8893 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:33.065251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a3dbafa3-75e5-4e5d-8d64-5132d98b8893 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:33.072263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a3dbafa3-75e5-4e5d-8d64-5132d98b8893 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:33.073024 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a3dbafa3-75e5-4e5d-8d64-5132d98b8893 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:33.074021 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a3dbafa3-75e5-4e5d-8d64-5132d98b8893 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:33.074532 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a3dbafa3-75e5-4e5d-8d64-5132d98b8893 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:33.261410 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a3dbafa3-75e5-4e5d-8d64-5132d98b8893 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:33.269443 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a3dbafa3-75e5-4e5d-8d64-5132d98b8893 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.211450 Jun 08 13:47:33.275769 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 64/132] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:33 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:33.700173 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8779b07a-71e6-4dae-85ee-b5a6780a157e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:33.701695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8779b07a-71e6-4dae-85ee-b5a6780a157e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:33.711602 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8779b07a-71e6-4dae-85ee-b5a6780a157e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:33.713488 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8779b07a-71e6-4dae-85ee-b5a6780a157e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:33.715714 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8779b07a-71e6-4dae-85ee-b5a6780a157e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:33.715956 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8779b07a-71e6-4dae-85ee-b5a6780a157e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:33.897108 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8779b07a-71e6-4dae-85ee-b5a6780a157e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:33.904654 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8779b07a-71e6-4dae-85ee-b5a6780a157e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.213018 Jun 08 13:47:33.905227 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 69/133] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:33 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:34.030011 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:34.030633 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:34.037706 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:34.043422 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:34.043422 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:34.043422 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:34.181759 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:34.199131 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:34.200685 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:34.201803 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-25f3aa84-c57f-4963-abb8-f08194cd5cf1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.176342 Jun 08 13:47:34.202368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 65/134] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:34 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:34.288961 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e71fb623-9a17-45cc-9137-41485217c2bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:34.289577 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e71fb623-9a17-45cc-9137-41485217c2bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:34.295907 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e71fb623-9a17-45cc-9137-41485217c2bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:34.296392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e71fb623-9a17-45cc-9137-41485217c2bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:34.297217 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e71fb623-9a17-45cc-9137-41485217c2bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:34.297662 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e71fb623-9a17-45cc-9137-41485217c2bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:34.437368 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e71fb623-9a17-45cc-9137-41485217c2bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:34.445735 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e71fb623-9a17-45cc-9137-41485217c2bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.161433 Jun 08 13:47:34.453916 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 70/135] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:34 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:34.921396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-35987ea5-c108-4b6c-9392-188b85ef5184 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:34.921940 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-35987ea5-c108-4b6c-9392-188b85ef5184 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:34.930495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-35987ea5-c108-4b6c-9392-188b85ef5184 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:34.930983 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-35987ea5-c108-4b6c-9392-188b85ef5184 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:34.932041 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-35987ea5-c108-4b6c-9392-188b85ef5184 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:34.932702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-35987ea5-c108-4b6c-9392-188b85ef5184 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:34.933117 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-961a2fcb-3bae-459a-b28b-95973e3e3724 req-43071dd5-cbd9-40bd-9b66-6ec4c403d00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac779098-8aa5-40b8-ae7d-dc4e463f015b", "name": "network-vif-plugged", "status": "completed", "tag": "a0a7ddb0-7def-4156-9a5b-f3b477a1c311"}, {"server_uuid": "b6ff0599-d152-4940-9811-f1187ab922e0", "name": "network-vif-plugged", "status": "completed", "tag": "a043c6d6-d4b4-4d25-927f-f3ba0a63e491"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:34.942819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-961a2fcb-3bae-459a-b28b-95973e3e3724 req-43071dd5-cbd9-40bd-9b66-6ec4c403d00b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:34.943265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-961a2fcb-3bae-459a-b28b-95973e3e3724 req-43071dd5-cbd9-40bd-9b66-6ec4c403d00b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:34.956252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-961a2fcb-3bae-459a-b28b-95973e3e3724 req-43071dd5-cbd9-40bd-9b66-6ec4c403d00b service nova] Creating event network-vif-plugged:a0a7ddb0-7def-4156-9a5b-f3b477a1c311 for instance ac779098-8aa5-40b8-ae7d-dc4e463f015b on hv-cinder-81914 Jun 08 13:47:34.956840 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-961a2fcb-3bae-459a-b28b-95973e3e3724 req-43071dd5-cbd9-40bd-9b66-6ec4c403d00b service nova] Creating event network-vif-plugged:a043c6d6-d4b4-4d25-927f-f3ba0a63e491 for instance b6ff0599-d152-4940-9811-f1187ab922e0 on hv-cinder-81914 Jun 08 13:47:34.964251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-961a2fcb-3bae-459a-b28b-95973e3e3724 req-43071dd5-cbd9-40bd-9b66-6ec4c403d00b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034994 Jun 08 13:47:34.965267 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 71/136] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:47:35.091013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-35987ea5-c108-4b6c-9392-188b85ef5184 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:35.100658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-35987ea5-c108-4b6c-9392-188b85ef5184 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1362 microversion: 2.1 time: 0.181848 Jun 08 13:47:35.102142 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 66/137] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:34 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:35.220435 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:35.221137 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:35.227881 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:35.228356 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:35.229120 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:35.229640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:35.388684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:35.397175 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:35.398991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:35.400305 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-65da9e7e-0910-41ec-9ecc-a7be2e2632ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.184133 Jun 08 13:47:35.400892 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 72/138] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:35 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:35.465676 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b7725479-f4ec-496d-a147-83257a0e90f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:35.466446 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b7725479-f4ec-496d-a147-83257a0e90f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:35.478366 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b7725479-f4ec-496d-a147-83257a0e90f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:35.487773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b7725479-f4ec-496d-a147-83257a0e90f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:35.488821 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b7725479-f4ec-496d-a147-83257a0e90f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:35.489587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b7725479-f4ec-496d-a147-83257a0e90f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:35.701454 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b7725479-f4ec-496d-a147-83257a0e90f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:35.718266 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b7725479-f4ec-496d-a147-83257a0e90f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.256314 Jun 08 13:47:35.718861 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 67/139] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:35 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:36.118871 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0dcafdd1-50fe-4e35-a292-44e651b67bf7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:36.119587 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0dcafdd1-50fe-4e35-a292-44e651b67bf7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:36.126929 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0dcafdd1-50fe-4e35-a292-44e651b67bf7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:36.127574 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0dcafdd1-50fe-4e35-a292-44e651b67bf7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:36.128554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0dcafdd1-50fe-4e35-a292-44e651b67bf7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:36.129275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0dcafdd1-50fe-4e35-a292-44e651b67bf7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:36.283853 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0dcafdd1-50fe-4e35-a292-44e651b67bf7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:36.293067 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0dcafdd1-50fe-4e35-a292-44e651b67bf7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1547 microversion: 2.1 time: 0.178277 Jun 08 13:47:36.302687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 73/140] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:36 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:36.310439 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ae6bd7d2-6bdc-4a24-8ee0-6395284d8a07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:36.312669 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ae6bd7d2-6bdc-4a24-8ee0-6395284d8a07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:36.319742 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ae6bd7d2-6bdc-4a24-8ee0-6395284d8a07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:36.320480 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ae6bd7d2-6bdc-4a24-8ee0-6395284d8a07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:36.321320 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ae6bd7d2-6bdc-4a24-8ee0-6395284d8a07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:36.321990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ae6bd7d2-6bdc-4a24-8ee0-6395284d8a07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:36.406449 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ae6bd7d2-6bdc-4a24-8ee0-6395284d8a07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099812 Jun 08 13:47:36.407135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 68/141] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 8 13:47:36 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:47:36.420342 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:36.421537 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:36.428183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:36.428818 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:36.430023 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:36.430713 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:36.642911 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:36.653057 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:36.655000 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:36.656177 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-592d1728-4245-4706-964a-732cbbdf53b6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.240210 Jun 08 13:47:36.658481 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 74/142] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:36 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:36.737783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a89a3396-7dfd-464b-9c3e-f2464b9fd616 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:36.738500 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a89a3396-7dfd-464b-9c3e-f2464b9fd616 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:36.747600 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a89a3396-7dfd-464b-9c3e-f2464b9fd616 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:36.751408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a89a3396-7dfd-464b-9c3e-f2464b9fd616 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:36.752490 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a89a3396-7dfd-464b-9c3e-f2464b9fd616 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:36.756143 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a89a3396-7dfd-464b-9c3e-f2464b9fd616 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:36.993382 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-3b19a413-c011-4d26-b02e-62a67abb0348 req-0b9d7765-555a-4c4e-9fb5-f35fc6b36a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0eac024-11de-495f-81cd-85391caa0e2d", "name": "network-vif-plugged", "status": "completed", "tag": "10edcea1-58b0-4fcc-a997-70b2f8d25e44"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:37.014850 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-3b19a413-c011-4d26-b02e-62a67abb0348 req-0b9d7765-555a-4c4e-9fb5-f35fc6b36a2d service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:37.015622 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-3b19a413-c011-4d26-b02e-62a67abb0348 req-0b9d7765-555a-4c4e-9fb5-f35fc6b36a2d service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:37.046099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-3b19a413-c011-4d26-b02e-62a67abb0348 req-0b9d7765-555a-4c4e-9fb5-f35fc6b36a2d service nova] Creating event network-vif-plugged:10edcea1-58b0-4fcc-a997-70b2f8d25e44 for instance b0eac024-11de-495f-81cd-85391caa0e2d on hv-cinder-81914 Jun 08 13:47:37.073962 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-3b19a413-c011-4d26-b02e-62a67abb0348 req-0b9d7765-555a-4c4e-9fb5-f35fc6b36a2d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084248 Jun 08 13:47:37.075667 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 75/143] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:47:37.134012 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a89a3396-7dfd-464b-9c3e-f2464b9fd616 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:37.147406 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a89a3396-7dfd-464b-9c3e-f2464b9fd616 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.414128 Jun 08 13:47:37.157718 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 69/144] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:36 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:37.679137 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:37.679137 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:37.683857 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:37.688479 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:37.688479 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:37.688479 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:38.006003 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:38.006003 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:38.006480 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:38.006480 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7c4902ad-c0b0-4a3e-b5ab-9908945a279a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1406 microversion: 2.20 time: 0.180367 Jun 08 13:47:38.006480 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 76/145] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:37 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:38.165294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2743d777-b724-4a9b-9c29-52c83456ca41 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:38.166014 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2743d777-b724-4a9b-9c29-52c83456ca41 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:38.173458 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2743d777-b724-4a9b-9c29-52c83456ca41 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:38.173914 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2743d777-b724-4a9b-9c29-52c83456ca41 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:38.174762 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2743d777-b724-4a9b-9c29-52c83456ca41 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:38.175109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2743d777-b724-4a9b-9c29-52c83456ca41 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:38.274297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-e64576e5-8c0c-4c3d-b78f-8cb37c977d9b req-64bdda91-8d3e-48a6-985c-ec9473127b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1db0ac6d-b933-4abd-96b8-c1af36e06791", "tag": "38bbf42f-b3f0-44a4-992c-b83e8f85c80a"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:38.284880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e64576e5-8c0c-4c3d-b78f-8cb37c977d9b req-64bdda91-8d3e-48a6-985c-ec9473127b39 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:38.285321 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e64576e5-8c0c-4c3d-b78f-8cb37c977d9b req-64bdda91-8d3e-48a6-985c-ec9473127b39 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:38.318189 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-e64576e5-8c0c-4c3d-b78f-8cb37c977d9b req-64bdda91-8d3e-48a6-985c-ec9473127b39 service nova] Creating event network-changed:38bbf42f-b3f0-44a4-992c-b83e8f85c80a for instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 on hv-cinder-81914 Jun 08 13:47:38.333715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-e64576e5-8c0c-4c3d-b78f-8cb37c977d9b req-64bdda91-8d3e-48a6-985c-ec9473127b39 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062701 Jun 08 13:47:38.334916 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 77/146] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:47:38.472216 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2743d777-b724-4a9b-9c29-52c83456ca41 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:38.487053 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2743d777-b724-4a9b-9c29-52c83456ca41 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.325384 Jun 08 13:47:38.488835 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 70/147] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:38 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:39.004299 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:39.005701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:39.013553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:39.013979 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:39.014745 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:39.015176 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:39.018065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=100 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:39.226509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:39.247859 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:39.250406 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:39.251616 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-aebde538-0fe6-4138-a892-2f2c4c1efda5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1595 microversion: 2.20 time: 0.251938 Jun 08 13:47:39.252211 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 78/148] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:47:38 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1595 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:47:39.275306 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-35df0a92-9c11-425b-8339-2ee623e5071a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:39.275835 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-35df0a92-9c11-425b-8339-2ee623e5071a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:39.282665 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-35df0a92-9c11-425b-8339-2ee623e5071a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:39.283310 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-35df0a92-9c11-425b-8339-2ee623e5071a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:39.284397 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-35df0a92-9c11-425b-8339-2ee623e5071a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:39.284988 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-35df0a92-9c11-425b-8339-2ee623e5071a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:39.368763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-35df0a92-9c11-425b-8339-2ee623e5071a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097982 Jun 08 13:47:39.369473 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 71/149] 10.222.0.55 () {60 vars in 1315 bytes} [Wed Jun 8 13:47:39 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:47:39.508841 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9e977ec8-3da4-4c33-ab72-63bba2ef9c03 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:39.538661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9e977ec8-3da4-4c33-ab72-63bba2ef9c03 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:39.538661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e977ec8-3da4-4c33-ab72-63bba2ef9c03 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:39.538661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e977ec8-3da4-4c33-ab72-63bba2ef9c03 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:39.538661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e977ec8-3da4-4c33-ab72-63bba2ef9c03 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:39.539113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e977ec8-3da4-4c33-ab72-63bba2ef9c03 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:39.971958 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9e977ec8-3da4-4c33-ab72-63bba2ef9c03 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:39.998527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9e977ec8-3da4-4c33-ab72-63bba2ef9c03 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1321 microversion: 2.1 time: 0.494803 Jun 08 13:47:40.002452 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 79/150] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:39 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:41.017397 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-dc43a844-165c-4d53-9af7-ef4ac8d7f29d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:41.018088 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-dc43a844-165c-4d53-9af7-ef4ac8d7f29d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:41.020445 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=99 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:41.025260 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dc43a844-165c-4d53-9af7-ef4ac8d7f29d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:41.025811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dc43a844-165c-4d53-9af7-ef4ac8d7f29d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:41.026724 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dc43a844-165c-4d53-9af7-ef4ac8d7f29d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:41.027273 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dc43a844-165c-4d53-9af7-ef4ac8d7f29d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:41.219496 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-dc43a844-165c-4d53-9af7-ef4ac8d7f29d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:41.229253 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-dc43a844-165c-4d53-9af7-ef4ac8d7f29d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1514 microversion: 2.1 time: 0.216104 Jun 08 13:47:41.229907 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 72/151] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:41 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:41.247559 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-86f4f7fc-9686-40aa-9de4-9f0fe2ecf0a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:41.248604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-86f4f7fc-9686-40aa-9de4-9f0fe2ecf0a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:41.254976 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-86f4f7fc-9686-40aa-9de4-9f0fe2ecf0a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:41.255760 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-86f4f7fc-9686-40aa-9de4-9f0fe2ecf0a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:41.256736 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-86f4f7fc-9686-40aa-9de4-9f0fe2ecf0a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:41.257266 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-86f4f7fc-9686-40aa-9de4-9f0fe2ecf0a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:41.331595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-86f4f7fc-9686-40aa-9de4-9f0fe2ecf0a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lazy-loading 'flavor' on Instance uuid b0eac024-11de-495f-81cd-85391caa0e2d {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:47:41.408022 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-c84c428a-4e25-4e0d-ac0a-beb42134ce1f req-01f5c059-c4a4-4bf9-8375-87522b122b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac779098-8aa5-40b8-ae7d-dc4e463f015b", "tag": "a0a7ddb0-7def-4156-9a5b-f3b477a1c311"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:41.420870 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-c84c428a-4e25-4e0d-ac0a-beb42134ce1f req-01f5c059-c4a4-4bf9-8375-87522b122b30 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:41.421314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-c84c428a-4e25-4e0d-ac0a-beb42134ce1f req-01f5c059-c4a4-4bf9-8375-87522b122b30 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:41.437638 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-c84c428a-4e25-4e0d-ac0a-beb42134ce1f req-01f5c059-c4a4-4bf9-8375-87522b122b30 service nova] Creating event network-changed:a0a7ddb0-7def-4156-9a5b-f3b477a1c311 for instance ac779098-8aa5-40b8-ae7d-dc4e463f015b on hv-cinder-81914 Jun 08 13:47:41.442792 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-c84c428a-4e25-4e0d-ac0a-beb42134ce1f req-01f5c059-c4a4-4bf9-8375-87522b122b30 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040306 Jun 08 13:47:41.443396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 73/152] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:47:41.777911 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-86f4f7fc-9686-40aa-9de4-9f0fe2ecf0a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d/action" status: 200 len: 32 microversion: 2.1 time: 0.529384 Jun 08 13:47:41.783908 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 80/153] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:47:41 2022] POST /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d/action => generated 32 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:47:41.793001 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d17a6eeb-6c23-4207-a7e1-a4139bfa8c91 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:41.793001 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d17a6eeb-6c23-4207-a7e1-a4139bfa8c91 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:41.801213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d17a6eeb-6c23-4207-a7e1-a4139bfa8c91 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:41.801696 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d17a6eeb-6c23-4207-a7e1-a4139bfa8c91 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:41.805583 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d17a6eeb-6c23-4207-a7e1-a4139bfa8c91 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:41.806741 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d17a6eeb-6c23-4207-a7e1-a4139bfa8c91 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:42.080878 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d17a6eeb-6c23-4207-a7e1-a4139bfa8c91 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:42.093883 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d17a6eeb-6c23-4207-a7e1-a4139bfa8c91 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.309035 Jun 08 13:47:42.096801 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 74/154] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:41 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:43.113093 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-29747ab7-dc80-408d-8f7c-149d9f95f8fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:43.113799 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-29747ab7-dc80-408d-8f7c-149d9f95f8fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:43.123335 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29747ab7-dc80-408d-8f7c-149d9f95f8fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:43.123786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29747ab7-dc80-408d-8f7c-149d9f95f8fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:43.125427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29747ab7-dc80-408d-8f7c-149d9f95f8fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:43.127333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29747ab7-dc80-408d-8f7c-149d9f95f8fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:43.285429 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-29747ab7-dc80-408d-8f7c-149d9f95f8fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:43.296639 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-29747ab7-dc80-408d-8f7c-149d9f95f8fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.187793 Jun 08 13:47:43.297300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 81/155] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:43 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:43.961879 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ff02b584-e080-4ae3-b3c2-67380cc4624e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:43.963137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ff02b584-e080-4ae3-b3c2-67380cc4624e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:43.970144 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ff02b584-e080-4ae3-b3c2-67380cc4624e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:43.970604 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ff02b584-e080-4ae3-b3c2-67380cc4624e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:43.971641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ff02b584-e080-4ae3-b3c2-67380cc4624e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:43.972209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ff02b584-e080-4ae3-b3c2-67380cc4624e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:43.998620 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ff02b584-e080-4ae3-b3c2-67380cc4624e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Going to try to terminate instance {{(pid=124628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:47:44.329046 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bb9bd421-e77e-4c5f-8415-8b9bd77cf151 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:44.329046 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bb9bd421-e77e-4c5f-8415-8b9bd77cf151 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:44.332847 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bb9bd421-e77e-4c5f-8415-8b9bd77cf151 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:44.333369 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bb9bd421-e77e-4c5f-8415-8b9bd77cf151 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:44.334238 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bb9bd421-e77e-4c5f-8415-8b9bd77cf151 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:44.334763 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bb9bd421-e77e-4c5f-8415-8b9bd77cf151 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:44.369280 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ff02b584-e080-4ae3-b3c2-67380cc4624e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 204 len: 0 microversion: 2.1 time: 0.411082 Jun 08 13:47:44.369882 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 75/156] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:47:43 2022] DELETE /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:47:44.378521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a3fc8382-baf9-4adf-b5c8-ead88f6bf063 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:44.379229 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a3fc8382-baf9-4adf-b5c8-ead88f6bf063 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:44.385974 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a3fc8382-baf9-4adf-b5c8-ead88f6bf063 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:44.386427 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a3fc8382-baf9-4adf-b5c8-ead88f6bf063 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:44.387377 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a3fc8382-baf9-4adf-b5c8-ead88f6bf063 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:44.387817 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a3fc8382-baf9-4adf-b5c8-ead88f6bf063 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:44.393069 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:47:44.549775 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bb9bd421-e77e-4c5f-8415-8b9bd77cf151 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:44.566242 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bb9bd421-e77e-4c5f-8415-8b9bd77cf151 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.244734 Jun 08 13:47:44.569334 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 82/157] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:44 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:44.587194 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a3fc8382-baf9-4adf-b5c8-ead88f6bf063 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:44.596875 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a3fc8382-baf9-4adf-b5c8-ead88f6bf063 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1553 microversion: 2.1 time: 0.222093 Jun 08 13:47:44.599675 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 76/158] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:44 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:45.584558 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ae989d15-c296-4728-9e6b-8fb1959676d1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:45.585165 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ae989d15-c296-4728-9e6b-8fb1959676d1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:45.591181 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ae989d15-c296-4728-9e6b-8fb1959676d1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:45.591628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ae989d15-c296-4728-9e6b-8fb1959676d1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:45.593458 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ae989d15-c296-4728-9e6b-8fb1959676d1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:45.593458 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ae989d15-c296-4728-9e6b-8fb1959676d1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:45.618335 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1a30e4eb-aeaa-4dac-ba3f-ffc3393d95f6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:45.622146 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1a30e4eb-aeaa-4dac-ba3f-ffc3393d95f6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:45.626691 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a30e4eb-aeaa-4dac-ba3f-ffc3393d95f6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:45.627135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a30e4eb-aeaa-4dac-ba3f-ffc3393d95f6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:45.627958 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a30e4eb-aeaa-4dac-ba3f-ffc3393d95f6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:45.628530 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a30e4eb-aeaa-4dac-ba3f-ffc3393d95f6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:45.796609 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ae989d15-c296-4728-9e6b-8fb1959676d1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:45.804776 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ae989d15-c296-4728-9e6b-8fb1959676d1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.224935 Jun 08 13:47:45.805442 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 83/159] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:45 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:45.826534 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1a30e4eb-aeaa-4dac-ba3f-ffc3393d95f6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:45.834544 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1a30e4eb-aeaa-4dac-ba3f-ffc3393d95f6 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1553 microversion: 2.1 time: 0.221922 Jun 08 13:47:45.835114 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 77/160] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:45 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:46.822240 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bfd159f5-7979-455a-9525-fb68897cdab0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:46.833306 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bfd159f5-7979-455a-9525-fb68897cdab0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:46.833306 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bfd159f5-7979-455a-9525-fb68897cdab0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:46.833306 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bfd159f5-7979-455a-9525-fb68897cdab0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:46.833306 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bfd159f5-7979-455a-9525-fb68897cdab0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:46.833747 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bfd159f5-7979-455a-9525-fb68897cdab0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:46.850809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-fd92d23c-3935-44d8-92ec-8c79c19ab30d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:46.851998 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-fd92d23c-3935-44d8-92ec-8c79c19ab30d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:46.868472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fd92d23c-3935-44d8-92ec-8c79c19ab30d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:46.868472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fd92d23c-3935-44d8-92ec-8c79c19ab30d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:46.868472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fd92d23c-3935-44d8-92ec-8c79c19ab30d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:46.868472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fd92d23c-3935-44d8-92ec-8c79c19ab30d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:47.087907 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bfd159f5-7979-455a-9525-fb68897cdab0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:47.096281 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-fd92d23c-3935-44d8-92ec-8c79c19ab30d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:47.100000 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bfd159f5-7979-455a-9525-fb68897cdab0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.281605 Jun 08 13:47:47.100619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 84/161] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:46 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:47.116245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-fd92d23c-3935-44d8-92ec-8c79c19ab30d tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1553 microversion: 2.1 time: 0.269387 Jun 08 13:47:47.117283 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 78/162] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:46 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:47.183673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-7c483fb2-3f80-4a21-b54a-4f478527a31a req-b110b3cc-418f-432b-aae5-f54d6e9ef011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee648927-27a4-4ca6-a341-22a82e9e54a2", "name": "network-vif-deleted", "tag": "07b64f58-2f27-4e2b-b1cb-fd9712202bf8"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:47:47.200203 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-7c483fb2-3f80-4a21-b54a-4f478527a31a req-b110b3cc-418f-432b-aae5-f54d6e9ef011 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:47.202550 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-7c483fb2-3f80-4a21-b54a-4f478527a31a req-b110b3cc-418f-432b-aae5-f54d6e9ef011 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:47.225652 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-7c483fb2-3f80-4a21-b54a-4f478527a31a req-b110b3cc-418f-432b-aae5-f54d6e9ef011 service nova] Creating event network-vif-deleted:07b64f58-2f27-4e2b-b1cb-fd9712202bf8 for instance ee648927-27a4-4ca6-a341-22a82e9e54a2 on hv-cinder-81914 Jun 08 13:47:47.230766 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-7c483fb2-3f80-4a21-b54a-4f478527a31a req-b110b3cc-418f-432b-aae5-f54d6e9ef011 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058719 Jun 08 13:47:47.231580 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 85/163] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:47:48.116908 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-790376c0-35f7-4e01-a57e-41f22afb3b7d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:48.118030 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-790376c0-35f7-4e01-a57e-41f22afb3b7d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:48.125135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-790376c0-35f7-4e01-a57e-41f22afb3b7d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:48.125677 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-790376c0-35f7-4e01-a57e-41f22afb3b7d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:48.126539 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-790376c0-35f7-4e01-a57e-41f22afb3b7d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:48.127045 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-790376c0-35f7-4e01-a57e-41f22afb3b7d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:48.136865 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:48.138177 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:48.146431 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:48.146900 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:48.147725 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:48.148183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:48.183690 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:48.184318 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:48.185096 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lazy-loading 'fault' on Instance uuid ee648927-27a4-4ca6-a341-22a82e9e54a2 {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:47:48.250665 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd00cf03b884d8999591ae4db0c1bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6598a073a442958076b48bed28c472', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:48.257179 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6563db78-e8a5-4642-82ed-0ad3eeeb0c80 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 200 len: 1350 microversion: 2.1 time: 0.125123 Jun 08 13:47:48.258032 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 86/164] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:48 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 1350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:47:48.295278 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-790376c0-35f7-4e01-a57e-41f22afb3b7d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:48.303591 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-790376c0-35f7-4e01-a57e-41f22afb3b7d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.190882 Jun 08 13:47:48.309017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 79/165] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:48 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:49.275521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:49.276352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:49.282615 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:49.283072 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:49.283857 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:49.284436 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:49.300042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] HTTP exception thrown: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Request method failure captured: Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 HTTP/1.1 Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKg-jhQWEDEIPX2M-oS3PrNL2w8N4Gy-53WCEJWHgcWjaqspe598fIUSMgJ3BRFJolLN0NCjQ43WdSkxT9l4RJ-gm5bt3mGoRM71ivjPdtWC9GZ2HCJnUXvuA18GkRFK5gmB9EETczPTuJU-OkYaQvsI2BDCT6baAlVzVHDB2H-fHQw Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9e6598a073a442958076b48bed28c472 Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:47:49.309980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9e6598a073a442958076b48bed28c472"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9e6598a073a442958076b48bed28c472", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9e6598a073a442958076b48bed28c472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9e6598a073a442958076b48bed28c472"}]}] Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9e6598a073a442958076b48bed28c472 Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-DeleteServersTestJSON-1822897200-project Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 8fd00cf03b884d8999591ae4db0c1bc5 Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-DeleteServersTestJSON-1822897200-project Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.311352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'ee648927-27a4-4ca6-a341-22a82e9e54a2'} Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:47:49.312252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.313331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.314439 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Returning 404 to user: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:47:49.315248 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f6f9f03a-acb7-4f1d-8e99-9841390db12e tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 404 len: 111 microversion: 2.1 time: 0.044134 Jun 08 13:47:49.315845 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 87/166] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:49 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:47:49.323164 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ea2d36d5-443c-4788-8d79-ccb1bf9be326 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:49.323787 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ea2d36d5-443c-4788-8d79-ccb1bf9be326 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:49.331632 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ea2d36d5-443c-4788-8d79-ccb1bf9be326 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:49.332148 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ea2d36d5-443c-4788-8d79-ccb1bf9be326 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:49.333266 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ea2d36d5-443c-4788-8d79-ccb1bf9be326 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:49.333938 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ea2d36d5-443c-4788-8d79-ccb1bf9be326 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:49.491897 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:49.493407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:49.495020 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ea2d36d5-443c-4788-8d79-ccb1bf9be326 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:49.500441 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:49.500887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:49.501967 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:49.502696 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:49.503100 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ea2d36d5-443c-4788-8d79-ccb1bf9be326 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.184220 Jun 08 13:47:49.503760 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 80/167] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:49 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:49.518926 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] HTTP exception thrown: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Request method failure captured: Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2/os-volume_attachments HTTP/1.1 Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKg-jhQWEDEIPX2M-oS3PrNL2w8N4Gy-53WCEJWHgcWjaqspe598fIUSMgJ3BRFJolLN0NCjQ43WdSkxT9l4RJ-gm5bt3mGoRM71ivjPdtWC9GZ2HCJnUXvuA18GkRFK5gmB9EETczPTuJU-OkYaQvsI2BDCT6baAlVzVHDB2H-fHQw Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9e6598a073a442958076b48bed28c472 Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:47:49.521543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9e6598a073a442958076b48bed28c472"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9e6598a073a442958076b48bed28c472", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9e6598a073a442958076b48bed28c472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9e6598a073a442958076b48bed28c472"}]}] Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9e6598a073a442958076b48bed28c472 Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-DeleteServersTestJSON-1822897200-project Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 8fd00cf03b884d8999591ae4db0c1bc5 Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-DeleteServersTestJSON-1822897200-project Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.522934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'server_id': 'ee648927-27a4-4ca6-a341-22a82e9e54a2'} Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:47:49.523589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:49.524699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:49.527202 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Returning 404 to user: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:47:49.527202 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-eb847d2d-0715-4dcd-97d6-394f3a1cd180 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038336 Jun 08 13:47:49.527979 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 88/168] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:47:49 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:47:50.521582 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4942f247-7cf1-4fe6-ba32-b14df2695775 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:50.522320 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4942f247-7cf1-4fe6-ba32-b14df2695775 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:50.530506 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4942f247-7cf1-4fe6-ba32-b14df2695775 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:50.531051 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4942f247-7cf1-4fe6-ba32-b14df2695775 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:50.531977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4942f247-7cf1-4fe6-ba32-b14df2695775 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:50.532516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4942f247-7cf1-4fe6-ba32-b14df2695775 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:50.686676 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4942f247-7cf1-4fe6-ba32-b14df2695775 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:50.695312 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4942f247-7cf1-4fe6-ba32-b14df2695775 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.178548 Jun 08 13:47:50.696191 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 81/169] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:50 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:50.966332 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:50.970937 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:50.974292 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:50.975120 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:50.976243 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:50.976944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:50.993781 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] HTTP exception thrown: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Request method failure captured: Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: DELETE /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 HTTP/1.1 Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKg-jhQWEDEIPX2M-oS3PrNL2w8N4Gy-53WCEJWHgcWjaqspe598fIUSMgJ3BRFJolLN0NCjQ43WdSkxT9l4RJ-gm5bt3mGoRM71ivjPdtWC9GZ2HCJnUXvuA18GkRFK5gmB9EETczPTuJU-OkYaQvsI2BDCT6baAlVzVHDB2H-fHQw Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9e6598a073a442958076b48bed28c472 Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:47:50.998829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9e6598a073a442958076b48bed28c472"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9e6598a073a442958076b48bed28c472", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9e6598a073a442958076b48bed28c472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9e6598a073a442958076b48bed28c472"}]}] Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9e6598a073a442958076b48bed28c472 Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-DeleteServersTestJSON-1822897200-project Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 8fd00cf03b884d8999591ae4db0c1bc5 Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-DeleteServersTestJSON-1822897200-project Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:51.000516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'ee648927-27a4-4ca6-a341-22a82e9e54a2'} Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:47:51.010313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:51.011632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.013192 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Returning 404 to user: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:47:51.013192 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-19e7b0c8-43f9-49bd-8fe2-b97dd61c9304 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 404 len: 111 microversion: 2.1 time: 0.041833 Jun 08 13:47:51.013192 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 89/170] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:47:50 2022] DELETE /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:47:51.022638 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:51.023777 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] [instance: ee648927-27a4-4ca6-a341-22a82e9e54a2] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:51.047229 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:51.047978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:51.049160 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:51.050463 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:51.071741 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] HTTP exception thrown: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Request method failure captured: Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 HTTP/1.1 Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKg-jhQWEDEIPX2M-oS3PrNL2w8N4Gy-53WCEJWHgcWjaqspe598fIUSMgJ3BRFJolLN0NCjQ43WdSkxT9l4RJ-gm5bt3mGoRM71ivjPdtWC9GZ2HCJnUXvuA18GkRFK5gmB9EETczPTuJU-OkYaQvsI2BDCT6baAlVzVHDB2H-fHQw Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 9e6598a073a442958076b48bed28c472 Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:47:51.079284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9e6598a073a442958076b48bed28c472"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9e6598a073a442958076b48bed28c472", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9e6598a073a442958076b48bed28c472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9e6598a073a442958076b48bed28c472"}]}] Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 9e6598a073a442958076b48bed28c472 Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-DeleteServersTestJSON-1822897200 Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-DeleteServersTestJSON-1822897200-project Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 8fd00cf03b884d8999591ae4db0c1bc5 Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-DeleteServersTestJSON-1822897200-project Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:51.080763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'ee648927-27a4-4ca6-a341-22a82e9e54a2'} Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:47:51.081537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. Jun 08 13:47:51.083504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:47:51.084757 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] Returning 404 to user: Instance ee648927-27a4-4ca6-a341-22a82e9e54a2 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:47:51.084757 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-235278f1-e563-4bea-9841-fe572e444cd7 tempest-DeleteServersTestJSON-1822897200 tempest-DeleteServersTestJSON-1822897200-project] 10.222.0.55 "GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2" status: 404 len: 111 microversion: 2.1 time: 0.063786 Jun 08 13:47:51.084757 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 82/171] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:51 2022] GET /compute/v2.1/servers/ee648927-27a4-4ca6-a341-22a82e9e54a2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:47:51.729905 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8d27b81a-49c0-4819-ad85-f2409c3caf56 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:51.732527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8d27b81a-49c0-4819-ad85-f2409c3caf56 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:51.746550 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8d27b81a-49c0-4819-ad85-f2409c3caf56 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:51.748085 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8d27b81a-49c0-4819-ad85-f2409c3caf56 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:51.750248 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8d27b81a-49c0-4819-ad85-f2409c3caf56 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:51.750878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8d27b81a-49c0-4819-ad85-f2409c3caf56 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:51.985113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8d27b81a-49c0-4819-ad85-f2409c3caf56 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:51.993026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8d27b81a-49c0-4819-ad85-f2409c3caf56 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.281843 Jun 08 13:47:51.993837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 90/172] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:51 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:53.010093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-222ac88a-e23c-4413-b401-dea60cf74d42 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:53.010694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-222ac88a-e23c-4413-b401-dea60cf74d42 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:53.017221 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-222ac88a-e23c-4413-b401-dea60cf74d42 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:53.017678 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-222ac88a-e23c-4413-b401-dea60cf74d42 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:53.018445 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-222ac88a-e23c-4413-b401-dea60cf74d42 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:53.018886 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-222ac88a-e23c-4413-b401-dea60cf74d42 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:53.162967 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-222ac88a-e23c-4413-b401-dea60cf74d42 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:53.170401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-222ac88a-e23c-4413-b401-dea60cf74d42 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.164337 Jun 08 13:47:53.170962 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 83/173] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:53 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:54.188325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-678795b3-ca5c-4b0c-8bb6-1275dfef2083 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:54.189324 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-678795b3-ca5c-4b0c-8bb6-1275dfef2083 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:54.196301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-678795b3-ca5c-4b0c-8bb6-1275dfef2083 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:54.197767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-678795b3-ca5c-4b0c-8bb6-1275dfef2083 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:54.198315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-678795b3-ca5c-4b0c-8bb6-1275dfef2083 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:54.198909 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-678795b3-ca5c-4b0c-8bb6-1275dfef2083 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:54.344618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-678795b3-ca5c-4b0c-8bb6-1275dfef2083 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:54.354991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-678795b3-ca5c-4b0c-8bb6-1275dfef2083 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.170751 Jun 08 13:47:54.356132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 91/174] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:54 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:55.371966 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f8eae85d-2d0e-49c1-a24c-734dcc53ff51 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:55.373408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f8eae85d-2d0e-49c1-a24c-734dcc53ff51 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:55.380639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f8eae85d-2d0e-49c1-a24c-734dcc53ff51 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:55.381086 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f8eae85d-2d0e-49c1-a24c-734dcc53ff51 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:55.381846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f8eae85d-2d0e-49c1-a24c-734dcc53ff51 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:55.382276 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f8eae85d-2d0e-49c1-a24c-734dcc53ff51 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:55.532402 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f8eae85d-2d0e-49c1-a24c-734dcc53ff51 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:55.541065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f8eae85d-2d0e-49c1-a24c-734dcc53ff51 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.172770 Jun 08 13:47:55.541545 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 84/175] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:55 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:56.558920 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c784aacc-7b4a-4258-8999-e56dba1a0e70 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:56.559572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c784aacc-7b4a-4258-8999-e56dba1a0e70 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:56.566270 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c784aacc-7b4a-4258-8999-e56dba1a0e70 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:56.566778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c784aacc-7b4a-4258-8999-e56dba1a0e70 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:56.567925 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c784aacc-7b4a-4258-8999-e56dba1a0e70 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:56.568405 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c784aacc-7b4a-4258-8999-e56dba1a0e70 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:56.741248 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c784aacc-7b4a-4258-8999-e56dba1a0e70 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:56.748871 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c784aacc-7b4a-4258-8999-e56dba1a0e70 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.193852 Jun 08 13:47:56.749444 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 92/176] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:56 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:57.765137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-12e7a9c7-0c1a-44ce-8d13-81b05c6007a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:57.765787 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-12e7a9c7-0c1a-44ce-8d13-81b05c6007a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:57.773161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-12e7a9c7-0c1a-44ce-8d13-81b05c6007a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:57.773616 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-12e7a9c7-0c1a-44ce-8d13-81b05c6007a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:57.774405 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-12e7a9c7-0c1a-44ce-8d13-81b05c6007a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:57.774847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-12e7a9c7-0c1a-44ce-8d13-81b05c6007a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:57.914834 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-12e7a9c7-0c1a-44ce-8d13-81b05c6007a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:57.922263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-12e7a9c7-0c1a-44ce-8d13-81b05c6007a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.160955 Jun 08 13:47:57.922835 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 85/177] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:57 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:47:58.938992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bcdfb3d8-4f11-4d0b-af24-e4b92f5f58be tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:47:58.939543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bcdfb3d8-4f11-4d0b-af24-e4b92f5f58be tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:47:58.946450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bcdfb3d8-4f11-4d0b-af24-e4b92f5f58be tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:58.946902 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bcdfb3d8-4f11-4d0b-af24-e4b92f5f58be tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:58.947661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bcdfb3d8-4f11-4d0b-af24-e4b92f5f58be tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:47:58.948131 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bcdfb3d8-4f11-4d0b-af24-e4b92f5f58be tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:47:59.087032 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bcdfb3d8-4f11-4d0b-af24-e4b92f5f58be tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:47:59.102672 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bcdfb3d8-4f11-4d0b-af24-e4b92f5f58be tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.167603 Jun 08 13:47:59.103626 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 93/178] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:47:58 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:00.120577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4174a46e-f748-426e-ab09-93f690aa3631 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:00.121224 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4174a46e-f748-426e-ab09-93f690aa3631 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:00.127739 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4174a46e-f748-426e-ab09-93f690aa3631 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:00.128231 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4174a46e-f748-426e-ab09-93f690aa3631 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:00.129607 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4174a46e-f748-426e-ab09-93f690aa3631 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:00.130049 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4174a46e-f748-426e-ab09-93f690aa3631 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:00.263294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4174a46e-f748-426e-ab09-93f690aa3631 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:00.271754 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4174a46e-f748-426e-ab09-93f690aa3631 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.155263 Jun 08 13:48:00.272355 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 86/179] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:00 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:01.288172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1989e398-4afb-441a-b460-0af101da3cf7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:01.288847 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1989e398-4afb-441a-b460-0af101da3cf7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:01.294852 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1989e398-4afb-441a-b460-0af101da3cf7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:01.295298 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1989e398-4afb-441a-b460-0af101da3cf7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:01.296076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1989e398-4afb-441a-b460-0af101da3cf7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:01.296523 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1989e398-4afb-441a-b460-0af101da3cf7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:01.627519 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1989e398-4afb-441a-b460-0af101da3cf7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:01.635616 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1989e398-4afb-441a-b460-0af101da3cf7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.351469 Jun 08 13:48:01.636210 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 94/180] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:01 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:02.653913 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-46b9f1aa-9569-4af0-b246-3cada71efbaf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:02.653913 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-46b9f1aa-9569-4af0-b246-3cada71efbaf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:02.658852 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-46b9f1aa-9569-4af0-b246-3cada71efbaf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:02.659304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-46b9f1aa-9569-4af0-b246-3cada71efbaf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:02.660648 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-46b9f1aa-9569-4af0-b246-3cada71efbaf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:02.661082 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-46b9f1aa-9569-4af0-b246-3cada71efbaf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:02.789378 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-46b9f1aa-9569-4af0-b246-3cada71efbaf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:02.796840 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-46b9f1aa-9569-4af0-b246-3cada71efbaf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.148673 Jun 08 13:48:02.797400 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 87/181] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:02 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:03.646999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-712166382", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "networks": [{"uuid": "f78d1fdb-0f8f-4ba8-9c46-69c0b872862d"}]}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:03.707751 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] validate_networks() for [('f78d1fdb-0f8f-4ba8-9c46-69c0b872862d', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:48:03.814910 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9b8d9257-e095-497a-a892-2463b66881ca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:03.816222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-9b8d9257-e095-497a-a892-2463b66881ca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:03.827080 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9b8d9257-e095-497a-a892-2463b66881ca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:03.827749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9b8d9257-e095-497a-a892-2463b66881ca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:03.828380 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9b8d9257-e095-497a-a892-2463b66881ca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:03.828823 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9b8d9257-e095-497a-a892-2463b66881ca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:04.076539 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-9b8d9257-e095-497a-a892-2463b66881ca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:04.086415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9b8d9257-e095-497a-a892-2463b66881ca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.275572 Jun 08 13:48:04.098035 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 88/182] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:03 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:04.172997 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:48:04.173450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:48:04.173985 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:48:04.174399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:48:04.174811 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:48:04.177058 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=62 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:04.185400 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:04.189243 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:04.189243 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:04.189243 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:04.193497 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:04.205563 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Getting quotas for project 1b38f30ffdc74b66aa2a5ed7d7eb1e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:48:04.212007 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Getting quotas for user 28d78d4ead234cc68e377c8b5b6e4d5a and project 1b38f30ffdc74b66aa2a5ed7d7eb1e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:48:04.224147 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:48:04.226360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:48:04.366381 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6e53fb98-701a-4d82-8b28-2b1080ccb8b7 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722476 Jun 08 13:48:04.366381 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 95/183] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:48:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:48:04.375755 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-40e96856-e5d2-4a09-8e80-3229a701046c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:04.376394 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-40e96856-e5d2-4a09-8e80-3229a701046c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:04.434282 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-40e96856-e5d2-4a09-8e80-3229a701046c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:04.444759 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-40e96856-e5d2-4a09-8e80-3229a701046c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1218 microversion: 2.1 time: 0.069754 Jun 08 13:48:04.444759 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 89/184] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:04 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:05.107309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5bb0454a-644a-4748-880b-1aa1e18acc40 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:05.107309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5bb0454a-644a-4748-880b-1aa1e18acc40 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:05.114119 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5bb0454a-644a-4748-880b-1aa1e18acc40 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:05.114731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5bb0454a-644a-4748-880b-1aa1e18acc40 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:05.115423 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5bb0454a-644a-4748-880b-1aa1e18acc40 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:05.115862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5bb0454a-644a-4748-880b-1aa1e18acc40 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:05.246811 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5bb0454a-644a-4748-880b-1aa1e18acc40 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:05.254577 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5bb0454a-644a-4748-880b-1aa1e18acc40 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.152812 Jun 08 13:48:05.255159 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 96/185] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:05 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:05.462019 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d9f79d6f-3902-4569-97f1-0807181bdc97 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:05.462634 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d9f79d6f-3902-4569-97f1-0807181bdc97 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:05.470025 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d9f79d6f-3902-4569-97f1-0807181bdc97 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:05.476370 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d9f79d6f-3902-4569-97f1-0807181bdc97 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:05.476370 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d9f79d6f-3902-4569-97f1-0807181bdc97 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:05.476370 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d9f79d6f-3902-4569-97f1-0807181bdc97 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:05.539531 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d9f79d6f-3902-4569-97f1-0807181bdc97 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:05.547317 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d9f79d6f-3902-4569-97f1-0807181bdc97 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1222 microversion: 2.1 time: 0.089332 Jun 08 13:48:05.547879 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 90/186] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:05 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:06.271787 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d1c7024a-2d82-480d-9677-7262faa5046a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:06.272381 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d1c7024a-2d82-480d-9677-7262faa5046a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:06.279053 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d1c7024a-2d82-480d-9677-7262faa5046a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:06.279504 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d1c7024a-2d82-480d-9677-7262faa5046a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:06.280299 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d1c7024a-2d82-480d-9677-7262faa5046a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:06.280742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d1c7024a-2d82-480d-9677-7262faa5046a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:06.405604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d1c7024a-2d82-480d-9677-7262faa5046a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:06.413250 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d1c7024a-2d82-480d-9677-7262faa5046a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.145848 Jun 08 13:48:06.415434 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 97/187] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:06 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:06.563883 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3c0667d5-e6a6-40f2-bb37-1b2b80aa83c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:06.564604 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3c0667d5-e6a6-40f2-bb37-1b2b80aa83c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:06.572657 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c0667d5-e6a6-40f2-bb37-1b2b80aa83c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:06.573116 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c0667d5-e6a6-40f2-bb37-1b2b80aa83c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:06.573936 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c0667d5-e6a6-40f2-bb37-1b2b80aa83c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:06.574454 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c0667d5-e6a6-40f2-bb37-1b2b80aa83c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:06.635897 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3c0667d5-e6a6-40f2-bb37-1b2b80aa83c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:06.643348 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3c0667d5-e6a6-40f2-bb37-1b2b80aa83c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1222 microversion: 2.1 time: 0.083395 Jun 08 13:48:06.643926 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 91/188] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:06 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:07.430757 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-39952c97-4369-4a26-ac89-53e8f95d225d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:07.431370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-39952c97-4369-4a26-ac89-53e8f95d225d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:07.437441 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-39952c97-4369-4a26-ac89-53e8f95d225d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:07.437894 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-39952c97-4369-4a26-ac89-53e8f95d225d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:07.438659 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-39952c97-4369-4a26-ac89-53e8f95d225d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:07.439098 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-39952c97-4369-4a26-ac89-53e8f95d225d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:07.574052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-39952c97-4369-4a26-ac89-53e8f95d225d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:07.581564 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-39952c97-4369-4a26-ac89-53e8f95d225d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.154810 Jun 08 13:48:07.582748 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 98/189] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:07 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:07.659927 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-966e3fa7-e8e2-4e4e-bedd-3d0d1275c7d2 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:07.660570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-966e3fa7-e8e2-4e4e-bedd-3d0d1275c7d2 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:07.667465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-966e3fa7-e8e2-4e4e-bedd-3d0d1275c7d2 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:07.667904 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-966e3fa7-e8e2-4e4e-bedd-3d0d1275c7d2 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:07.668694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-966e3fa7-e8e2-4e4e-bedd-3d0d1275c7d2 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:07.669123 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-966e3fa7-e8e2-4e4e-bedd-3d0d1275c7d2 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:07.731687 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-966e3fa7-e8e2-4e4e-bedd-3d0d1275c7d2 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:07.739844 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-966e3fa7-e8e2-4e4e-bedd-3d0d1275c7d2 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1214 microversion: 2.1 time: 0.083649 Jun 08 13:48:07.740761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 92/190] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:07 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:08.599605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-91a62eb0-cdd3-47b5-be8f-3d384d7c8ca3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:08.600426 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-91a62eb0-cdd3-47b5-be8f-3d384d7c8ca3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:08.606671 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-91a62eb0-cdd3-47b5-be8f-3d384d7c8ca3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:08.607098 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-91a62eb0-cdd3-47b5-be8f-3d384d7c8ca3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:08.607966 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-91a62eb0-cdd3-47b5-be8f-3d384d7c8ca3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:08.608294 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-91a62eb0-cdd3-47b5-be8f-3d384d7c8ca3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:08.753002 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-91a62eb0-cdd3-47b5-be8f-3d384d7c8ca3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:08.757693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-70fbebe9-d504-46c6-b68a-d7373e7a8ed9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:08.758936 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-70fbebe9-d504-46c6-b68a-d7373e7a8ed9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:08.761985 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-91a62eb0-cdd3-47b5-be8f-3d384d7c8ca3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.167025 Jun 08 13:48:08.765130 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 99/191] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:08 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:08.766166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-70fbebe9-d504-46c6-b68a-d7373e7a8ed9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:08.766619 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-70fbebe9-d504-46c6-b68a-d7373e7a8ed9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:08.767592 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-70fbebe9-d504-46c6-b68a-d7373e7a8ed9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:08.768222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-70fbebe9-d504-46c6-b68a-d7373e7a8ed9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:08.835134 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-70fbebe9-d504-46c6-b68a-d7373e7a8ed9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:08.842886 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-70fbebe9-d504-46c6-b68a-d7373e7a8ed9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1288 microversion: 2.1 time: 0.089577 Jun 08 13:48:08.843461 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 93/192] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:08 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:09.782251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-198cc363-0ed3-4873-b46c-2e996fad994f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:09.783176 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-198cc363-0ed3-4873-b46c-2e996fad994f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:09.789918 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-198cc363-0ed3-4873-b46c-2e996fad994f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:09.790371 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-198cc363-0ed3-4873-b46c-2e996fad994f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:09.791151 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-198cc363-0ed3-4873-b46c-2e996fad994f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:09.791591 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-198cc363-0ed3-4873-b46c-2e996fad994f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:09.871360 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-07c70577-8c8c-4f03-95d4-95a9f22c483a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:09.872749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-07c70577-8c8c-4f03-95d4-95a9f22c483a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:09.883296 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-07c70577-8c8c-4f03-95d4-95a9f22c483a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:09.883928 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-07c70577-8c8c-4f03-95d4-95a9f22c483a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:09.885073 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-07c70577-8c8c-4f03-95d4-95a9f22c483a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:09.885667 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-07c70577-8c8c-4f03-95d4-95a9f22c483a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:09.913330 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=100 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:10.004560 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-198cc363-0ed3-4873-b46c-2e996fad994f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:10.012380 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-198cc363-0ed3-4873-b46c-2e996fad994f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.234093 Jun 08 13:48:10.012966 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 100/193] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:09 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:10.052533 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-07c70577-8c8c-4f03-95d4-95a9f22c483a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:10.061557 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-07c70577-8c8c-4f03-95d4-95a9f22c483a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1318 microversion: 2.1 time: 0.194680 Jun 08 13:48:10.062537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 94/194] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:09 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:10.711096 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-d7b70585-63d9-47c2-9e07-9ca06f40c199 req-bb01a152-96b8-4fce-b562-33e436904eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f2101b3-fbbb-4d6e-a75e-05341cdd88f4", "tag": "05a82aa7-0a4e-4e39-9039-9e40ee1827d5"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:10.723404 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-d7b70585-63d9-47c2-9e07-9ca06f40c199 req-bb01a152-96b8-4fce-b562-33e436904eb8 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:10.724291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-d7b70585-63d9-47c2-9e07-9ca06f40c199 req-bb01a152-96b8-4fce-b562-33e436904eb8 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:10.739998 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-d7b70585-63d9-47c2-9e07-9ca06f40c199 req-bb01a152-96b8-4fce-b562-33e436904eb8 service nova] Creating event network-changed:05a82aa7-0a4e-4e39-9039-9e40ee1827d5 for instance 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 on hv-cinder-81914 Jun 08 13:48:10.744363 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-d7b70585-63d9-47c2-9e07-9ca06f40c199 req-bb01a152-96b8-4fce-b562-33e436904eb8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040924 Jun 08 13:48:10.745007 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 101/195] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:48:11.030392 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7a05a688-4e4b-4163-ac8d-6b80ff4ca646 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:11.046491 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7a05a688-4e4b-4163-ac8d-6b80ff4ca646 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:11.069113 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a05a688-4e4b-4163-ac8d-6b80ff4ca646 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:11.069586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a05a688-4e4b-4163-ac8d-6b80ff4ca646 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:11.070468 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a05a688-4e4b-4163-ac8d-6b80ff4ca646 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:11.070933 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a05a688-4e4b-4163-ac8d-6b80ff4ca646 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:11.083149 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ac84240f-61c7-4cc9-b453-92cd68d6c57d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:11.091932 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ac84240f-61c7-4cc9-b453-92cd68d6c57d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:11.107155 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ac84240f-61c7-4cc9-b453-92cd68d6c57d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:11.107838 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ac84240f-61c7-4cc9-b453-92cd68d6c57d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:11.109109 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ac84240f-61c7-4cc9-b453-92cd68d6c57d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:11.109758 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ac84240f-61c7-4cc9-b453-92cd68d6c57d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:11.302526 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ac84240f-61c7-4cc9-b453-92cd68d6c57d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:11.310130 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ac84240f-61c7-4cc9-b453-92cd68d6c57d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1318 microversion: 2.1 time: 0.231652 Jun 08 13:48:11.326853 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 102/196] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:11 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:11.375278 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7a05a688-4e4b-4163-ac8d-6b80ff4ca646 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:11.383984 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7a05a688-4e4b-4163-ac8d-6b80ff4ca646 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.357761 Jun 08 13:48:11.384595 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 95/197] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:11 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:12.327775 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-604718aa-bc27-4fc3-89de-5a8c40dc5471 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:12.328503 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-604718aa-bc27-4fc3-89de-5a8c40dc5471 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:12.335128 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-604718aa-bc27-4fc3-89de-5a8c40dc5471 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:12.335630 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-604718aa-bc27-4fc3-89de-5a8c40dc5471 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:12.336432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-604718aa-bc27-4fc3-89de-5a8c40dc5471 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:12.336867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-604718aa-bc27-4fc3-89de-5a8c40dc5471 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:12.401313 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2b0f6ec9-13d6-464d-87ad-7197d1b3b1c6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:12.401948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2b0f6ec9-13d6-464d-87ad-7197d1b3b1c6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:12.404730 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:12.411712 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2b0f6ec9-13d6-464d-87ad-7197d1b3b1c6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:12.412593 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2b0f6ec9-13d6-464d-87ad-7197d1b3b1c6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:12.415709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2b0f6ec9-13d6-464d-87ad-7197d1b3b1c6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:12.415709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2b0f6ec9-13d6-464d-87ad-7197d1b3b1c6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:12.587450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-604718aa-bc27-4fc3-89de-5a8c40dc5471 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:12.594988 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-604718aa-bc27-4fc3-89de-5a8c40dc5471 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1318 microversion: 2.1 time: 0.271048 Jun 08 13:48:12.595588 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 103/198] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:12 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:12.626744 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2b0f6ec9-13d6-464d-87ad-7197d1b3b1c6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:12.634984 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2b0f6ec9-13d6-464d-87ad-7197d1b3b1c6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.237601 Jun 08 13:48:12.635399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 96/199] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:12 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:13.611705 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-491e279b-5b95-4580-a3f3-909dbab3e599 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:13.612370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-491e279b-5b95-4580-a3f3-909dbab3e599 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:13.618427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-491e279b-5b95-4580-a3f3-909dbab3e599 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:13.618880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-491e279b-5b95-4580-a3f3-909dbab3e599 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:13.619628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-491e279b-5b95-4580-a3f3-909dbab3e599 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:13.620078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-491e279b-5b95-4580-a3f3-909dbab3e599 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:13.654471 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1a7ce0fc-0d20-4adf-9ee9-fecb82688599 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:13.655720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1a7ce0fc-0d20-4adf-9ee9-fecb82688599 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:13.663286 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a7ce0fc-0d20-4adf-9ee9-fecb82688599 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:13.664824 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a7ce0fc-0d20-4adf-9ee9-fecb82688599 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:13.664824 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a7ce0fc-0d20-4adf-9ee9-fecb82688599 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:13.665098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a7ce0fc-0d20-4adf-9ee9-fecb82688599 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:13.907006 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-491e279b-5b95-4580-a3f3-909dbab3e599 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:13.913473 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1a7ce0fc-0d20-4adf-9ee9-fecb82688599 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:13.915193 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-491e279b-5b95-4580-a3f3-909dbab3e599 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1318 microversion: 2.1 time: 0.307226 Jun 08 13:48:13.916115 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 104/200] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:13 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:13.931396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1a7ce0fc-0d20-4adf-9ee9-fecb82688599 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.280713 Jun 08 13:48:13.931976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 97/201] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:13 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:14.932223 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-95f81b5e-a1cb-4857-82b8-c04c6e3b3781 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:14.932836 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-95f81b5e-a1cb-4857-82b8-c04c6e3b3781 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:14.935615 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:14.936726 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=6 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:14.942960 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-95f81b5e-a1cb-4857-82b8-c04c6e3b3781 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:14.943308 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-95f81b5e-a1cb-4857-82b8-c04c6e3b3781 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:14.944151 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-95f81b5e-a1cb-4857-82b8-c04c6e3b3781 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:14.944719 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-95f81b5e-a1cb-4857-82b8-c04c6e3b3781 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:14.949573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-98b36185-b922-4b80-b9d8-21acc858832a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:14.950266 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-98b36185-b922-4b80-b9d8-21acc858832a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:14.958993 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:14.965429 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-98b36185-b922-4b80-b9d8-21acc858832a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:14.965912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-98b36185-b922-4b80-b9d8-21acc858832a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:14.968102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-98b36185-b922-4b80-b9d8-21acc858832a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:14.968369 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-98b36185-b922-4b80-b9d8-21acc858832a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:15.183623 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-98b36185-b922-4b80-b9d8-21acc858832a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:15.187430 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-95f81b5e-a1cb-4857-82b8-c04c6e3b3781 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:15.192846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-98b36185-b922-4b80-b9d8-21acc858832a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.248396 Jun 08 13:48:15.193539 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 98/202] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:14 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:15.198737 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-95f81b5e-a1cb-4857-82b8-c04c6e3b3781 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1318 microversion: 2.1 time: 0.270395 Jun 08 13:48:15.199873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 105/203] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:14 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:16.211084 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-704fab2c-f748-4270-9f1f-5033285811cf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:16.212642 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-704fab2c-f748-4270-9f1f-5033285811cf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:16.219176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-704fab2c-f748-4270-9f1f-5033285811cf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:16.219368 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2fbe38a1-eb85-467a-9371-bc2e492c833f tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:16.219791 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-704fab2c-f748-4270-9f1f-5033285811cf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:16.226525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2fbe38a1-eb85-467a-9371-bc2e492c833f tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:16.226674 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-704fab2c-f748-4270-9f1f-5033285811cf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:16.226674 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-704fab2c-f748-4270-9f1f-5033285811cf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:16.227872 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2fbe38a1-eb85-467a-9371-bc2e492c833f tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:16.228599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2fbe38a1-eb85-467a-9371-bc2e492c833f tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:16.229448 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2fbe38a1-eb85-467a-9371-bc2e492c833f tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:16.229959 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2fbe38a1-eb85-467a-9371-bc2e492c833f tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:16.426058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-704fab2c-f748-4270-9f1f-5033285811cf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:16.429164 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2fbe38a1-eb85-467a-9371-bc2e492c833f tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:16.433572 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-704fab2c-f748-4270-9f1f-5033285811cf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.227019 Jun 08 13:48:16.434217 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 99/204] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:16 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:16.437064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2fbe38a1-eb85-467a-9371-bc2e492c833f tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1318 microversion: 2.1 time: 0.222147 Jun 08 13:48:16.437680 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 106/205] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:16 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:17.186639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-1b5fc501-f07f-495b-b62e-8b177b2f3c34 req-acfe9f69-b075-4363-8329-c05f69ef62dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2101b3-fbbb-4d6e-a75e-05341cdd88f4", "name": "network-vif-plugged", "status": "completed", "tag": "05a82aa7-0a4e-4e39-9039-9e40ee1827d5"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:17.197821 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-1b5fc501-f07f-495b-b62e-8b177b2f3c34 req-acfe9f69-b075-4363-8329-c05f69ef62dc service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:17.198352 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-1b5fc501-f07f-495b-b62e-8b177b2f3c34 req-acfe9f69-b075-4363-8329-c05f69ef62dc service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:17.213697 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-1b5fc501-f07f-495b-b62e-8b177b2f3c34 req-acfe9f69-b075-4363-8329-c05f69ef62dc service nova] Creating event network-vif-plugged:05a82aa7-0a4e-4e39-9039-9e40ee1827d5 for instance 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 on hv-cinder-81914 Jun 08 13:48:17.220973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-1b5fc501-f07f-495b-b62e-8b177b2f3c34 req-acfe9f69-b075-4363-8329-c05f69ef62dc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039301 Jun 08 13:48:17.221888 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 100/206] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:48:17.450866 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9b2fcf48-f4f8-4a8d-a905-183b4c0958bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:17.451417 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9b2fcf48-f4f8-4a8d-a905-183b4c0958bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:17.455164 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-eebdb326-b0ca-4d71-902d-2980c6318d05 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:17.455951 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-eebdb326-b0ca-4d71-902d-2980c6318d05 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:17.457880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9b2fcf48-f4f8-4a8d-a905-183b4c0958bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:17.458327 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9b2fcf48-f4f8-4a8d-a905-183b4c0958bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:17.459093 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9b2fcf48-f4f8-4a8d-a905-183b4c0958bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:17.459529 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9b2fcf48-f4f8-4a8d-a905-183b4c0958bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:17.462895 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eebdb326-b0ca-4d71-902d-2980c6318d05 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:17.463420 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eebdb326-b0ca-4d71-902d-2980c6318d05 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:17.464293 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eebdb326-b0ca-4d71-902d-2980c6318d05 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:17.464797 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eebdb326-b0ca-4d71-902d-2980c6318d05 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:17.663728 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9b2fcf48-f4f8-4a8d-a905-183b4c0958bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:17.671795 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-eebdb326-b0ca-4d71-902d-2980c6318d05 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:17.678947 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9b2fcf48-f4f8-4a8d-a905-183b4c0958bd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.232069 Jun 08 13:48:17.683618 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-eebdb326-b0ca-4d71-902d-2980c6318d05 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1318 microversion: 2.1 time: 0.232645 Jun 08 13:48:17.684227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 101/207] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:17 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:17.685188 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 107/208] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:17 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:18.700412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-85d18674-96a6-4cd4-b8f7-32bd3801e92d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:18.705938 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a8484832-b11b-4fbd-8f2c-d6f3e40fbfe5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:18.717167 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a8484832-b11b-4fbd-8f2c-d6f3e40fbfe5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:18.717315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-85d18674-96a6-4cd4-b8f7-32bd3801e92d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:18.717315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-85d18674-96a6-4cd4-b8f7-32bd3801e92d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:18.717315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-85d18674-96a6-4cd4-b8f7-32bd3801e92d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:18.717315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-85d18674-96a6-4cd4-b8f7-32bd3801e92d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:18.717673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a8484832-b11b-4fbd-8f2c-d6f3e40fbfe5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:18.717673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a8484832-b11b-4fbd-8f2c-d6f3e40fbfe5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:18.718291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a8484832-b11b-4fbd-8f2c-d6f3e40fbfe5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:18.718472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-85d18674-96a6-4cd4-b8f7-32bd3801e92d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:18.718722 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a8484832-b11b-4fbd-8f2c-d6f3e40fbfe5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:18.915484 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a8484832-b11b-4fbd-8f2c-d6f3e40fbfe5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:18.919598 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-85d18674-96a6-4cd4-b8f7-32bd3801e92d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:18.923199 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a8484832-b11b-4fbd-8f2c-d6f3e40fbfe5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1318 microversion: 2.1 time: 0.221032 Jun 08 13:48:18.923812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 108/209] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:18 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:18.928715 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-85d18674-96a6-4cd4-b8f7-32bd3801e92d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1520 microversion: 2.1 time: 0.232171 Jun 08 13:48:18.934165 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 102/210] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:18 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:19.942087 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a5e352cb-36d8-4d68-a66a-90f581082dbb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:19.942706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a5e352cb-36d8-4d68-a66a-90f581082dbb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:19.946135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5a9c6cb2-e702-404c-b211-d7cdf3d8558e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:19.946744 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5a9c6cb2-e702-404c-b211-d7cdf3d8558e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:19.949963 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5e352cb-36d8-4d68-a66a-90f581082dbb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:19.951050 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5e352cb-36d8-4d68-a66a-90f581082dbb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:19.952012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5e352cb-36d8-4d68-a66a-90f581082dbb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:19.952621 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5e352cb-36d8-4d68-a66a-90f581082dbb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:19.953889 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a9c6cb2-e702-404c-b211-d7cdf3d8558e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:19.954442 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a9c6cb2-e702-404c-b211-d7cdf3d8558e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:19.955323 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a9c6cb2-e702-404c-b211-d7cdf3d8558e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:19.955864 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a9c6cb2-e702-404c-b211-d7cdf3d8558e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:20.147511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a5e352cb-36d8-4d68-a66a-90f581082dbb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:20.154196 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5a9c6cb2-e702-404c-b211-d7cdf3d8558e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:20.157759 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a5e352cb-36d8-4d68-a66a-90f581082dbb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1507 microversion: 2.1 time: 0.220225 Jun 08 13:48:20.158629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 109/211] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:19 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:20.163219 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5a9c6cb2-e702-404c-b211-d7cdf3d8558e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1500 microversion: 2.1 time: 0.220775 Jun 08 13:48:20.165585 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 103/212] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:19 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1500 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:20.185966 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f683afcd-4686-4996-9613-807bb835b735 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:20.187789 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f683afcd-4686-4996-9613-807bb835b735 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:20.194332 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f683afcd-4686-4996-9613-807bb835b735 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:20.194790 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f683afcd-4686-4996-9613-807bb835b735 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:20.195679 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f683afcd-4686-4996-9613-807bb835b735 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:20.196177 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f683afcd-4686-4996-9613-807bb835b735 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:20.356042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f683afcd-4686-4996-9613-807bb835b735 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:20.365829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f683afcd-4686-4996-9613-807bb835b735 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1515 microversion: 2.1 time: 0.183939 Jun 08 13:48:20.366773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 110/213] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:20 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:24.518472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-44144550-4937-4ce5-b690-d9abd56bc143 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:24.519946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-44144550-4937-4ce5-b690-d9abd56bc143 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:24.527214 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-44144550-4937-4ce5-b690-d9abd56bc143 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:24.527670 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-44144550-4937-4ce5-b690-d9abd56bc143 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:24.528645 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-44144550-4937-4ce5-b690-d9abd56bc143 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:24.529085 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-44144550-4937-4ce5-b690-d9abd56bc143 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:24.553129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-44144550-4937-4ce5-b690-d9abd56bc143 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lazy-loading 'flavor' on Instance uuid b6ff0599-d152-4940-9811-f1187ab922e0 {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:48:24.938776 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-44144550-4937-4ce5-b690-d9abd56bc143 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0/action" status: 200 len: 32 microversion: 2.1 time: 0.424446 Jun 08 13:48:24.946425 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 104/214] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:48:24 2022] POST /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:48:24.952690 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-19b9fce6-2816-4fd6-a6a9-2589e29f7316 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:24.954390 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-19b9fce6-2816-4fd6-a6a9-2589e29f7316 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:24.962167 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-19b9fce6-2816-4fd6-a6a9-2589e29f7316 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:24.962634 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-19b9fce6-2816-4fd6-a6a9-2589e29f7316 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:24.964124 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-19b9fce6-2816-4fd6-a6a9-2589e29f7316 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:24.964584 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-19b9fce6-2816-4fd6-a6a9-2589e29f7316 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:25.135839 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-19b9fce6-2816-4fd6-a6a9-2589e29f7316 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:25.143685 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-19b9fce6-2816-4fd6-a6a9-2589e29f7316 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.195524 Jun 08 13:48:25.145085 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 111/215] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:24 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:26.168289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-89514250-3b62-489a-a1d4-47baf2adae12 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:26.169004 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-89514250-3b62-489a-a1d4-47baf2adae12 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:26.175311 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-89514250-3b62-489a-a1d4-47baf2adae12 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:26.175798 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-89514250-3b62-489a-a1d4-47baf2adae12 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:26.176726 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-89514250-3b62-489a-a1d4-47baf2adae12 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:26.177172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-89514250-3b62-489a-a1d4-47baf2adae12 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:26.315020 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-89514250-3b62-489a-a1d4-47baf2adae12 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:26.324437 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-89514250-3b62-489a-a1d4-47baf2adae12 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.161336 Jun 08 13:48:26.325016 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 105/216] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:26 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:27.342930 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-30d9cad2-f06a-4d4c-9485-b0eaeed35587 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:27.343546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-30d9cad2-f06a-4d4c-9485-b0eaeed35587 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:27.359461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-30d9cad2-f06a-4d4c-9485-b0eaeed35587 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:27.360619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-30d9cad2-f06a-4d4c-9485-b0eaeed35587 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:27.361814 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-30d9cad2-f06a-4d4c-9485-b0eaeed35587 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:27.362407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-30d9cad2-f06a-4d4c-9485-b0eaeed35587 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:27.563715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-30d9cad2-f06a-4d4c-9485-b0eaeed35587 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:27.576427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-30d9cad2-f06a-4d4c-9485-b0eaeed35587 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.237447 Jun 08 13:48:27.577297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 112/217] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:27 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:28.600382 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bdeb8b08-a800-40a7-9496-74cf3b438cc9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:28.601615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bdeb8b08-a800-40a7-9496-74cf3b438cc9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:28.608287 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bdeb8b08-a800-40a7-9496-74cf3b438cc9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:28.608745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bdeb8b08-a800-40a7-9496-74cf3b438cc9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:28.609514 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bdeb8b08-a800-40a7-9496-74cf3b438cc9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:28.609957 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bdeb8b08-a800-40a7-9496-74cf3b438cc9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:28.741708 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bdeb8b08-a800-40a7-9496-74cf3b438cc9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:28.749375 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bdeb8b08-a800-40a7-9496-74cf3b438cc9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.153258 Jun 08 13:48:28.749946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 106/218] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:28 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:29.767597 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-12fdd297-8185-4413-ba2f-b74310bb9bdd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:29.768239 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-12fdd297-8185-4413-ba2f-b74310bb9bdd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:29.774945 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-12fdd297-8185-4413-ba2f-b74310bb9bdd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:29.775395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-12fdd297-8185-4413-ba2f-b74310bb9bdd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:29.776227 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-12fdd297-8185-4413-ba2f-b74310bb9bdd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:29.776604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-12fdd297-8185-4413-ba2f-b74310bb9bdd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:29.783385 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=100 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:29.907524 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-12fdd297-8185-4413-ba2f-b74310bb9bdd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:29.915161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-12fdd297-8185-4413-ba2f-b74310bb9bdd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.151470 Jun 08 13:48:29.915736 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 113/219] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:29 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:30.932180 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-242ce4d2-d13d-4595-8ce4-784e8f93444a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:30.932798 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-242ce4d2-d13d-4595-8ce4-784e8f93444a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:30.939145 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-242ce4d2-d13d-4595-8ce4-784e8f93444a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:30.939597 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-242ce4d2-d13d-4595-8ce4-784e8f93444a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:30.940919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-242ce4d2-d13d-4595-8ce4-784e8f93444a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:30.942255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-242ce4d2-d13d-4595-8ce4-784e8f93444a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:31.080040 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-242ce4d2-d13d-4595-8ce4-784e8f93444a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:31.087631 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-242ce4d2-d13d-4595-8ce4-784e8f93444a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.159220 Jun 08 13:48:31.088222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 107/220] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:30 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:32.105396 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-621973e8-8152-409b-b598-7a9b286797bf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:32.106042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-621973e8-8152-409b-b598-7a9b286797bf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:32.112424 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-621973e8-8152-409b-b598-7a9b286797bf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:32.112828 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-621973e8-8152-409b-b598-7a9b286797bf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:32.113770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-621973e8-8152-409b-b598-7a9b286797bf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:32.114200 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-621973e8-8152-409b-b598-7a9b286797bf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:32.246439 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-621973e8-8152-409b-b598-7a9b286797bf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:32.256664 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-621973e8-8152-409b-b598-7a9b286797bf tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.154723 Jun 08 13:48:32.256664 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 114/221] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:32 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:33.273961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-07648ff1-8f51-4346-bbba-ec78aae02585 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:33.274644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-07648ff1-8f51-4346-bbba-ec78aae02585 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:33.281276 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-07648ff1-8f51-4346-bbba-ec78aae02585 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:33.281772 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-07648ff1-8f51-4346-bbba-ec78aae02585 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:33.282615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-07648ff1-8f51-4346-bbba-ec78aae02585 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:33.283103 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-07648ff1-8f51-4346-bbba-ec78aae02585 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:33.445943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-07648ff1-8f51-4346-bbba-ec78aae02585 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:33.461006 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-07648ff1-8f51-4346-bbba-ec78aae02585 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.190768 Jun 08 13:48:33.461644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 108/222] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:33 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:33.875466 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7cccaeb7-4613-41a7-8306-fba122c9cc8f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:33.875996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7cccaeb7-4613-41a7-8306-fba122c9cc8f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:33.884912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7cccaeb7-4613-41a7-8306-fba122c9cc8f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:33.885842 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7cccaeb7-4613-41a7-8306-fba122c9cc8f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:33.890767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7cccaeb7-4613-41a7-8306-fba122c9cc8f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:33.890767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7cccaeb7-4613-41a7-8306-fba122c9cc8f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:33.916553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7cccaeb7-4613-41a7-8306-fba122c9cc8f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/ips" status: 200 len: 145 microversion: 2.1 time: 0.044517 Jun 08 13:48:33.917665 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 115/223] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:48:33 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:48:34.492210 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-54ff41bb-2dab-4f03-8a55-c239944c2672 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:34.492753 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-54ff41bb-2dab-4f03-8a55-c239944c2672 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:34.499561 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-54ff41bb-2dab-4f03-8a55-c239944c2672 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:34.500017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-54ff41bb-2dab-4f03-8a55-c239944c2672 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:34.500929 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-54ff41bb-2dab-4f03-8a55-c239944c2672 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:34.501264 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-54ff41bb-2dab-4f03-8a55-c239944c2672 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:34.629259 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-54ff41bb-2dab-4f03-8a55-c239944c2672 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:34.632814 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:34.637301 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-54ff41bb-2dab-4f03-8a55-c239944c2672 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.149724 Jun 08 13:48:34.637874 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 109/224] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:34 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:35.653907 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-084f98ab-cfa0-4540-aec5-4a885ef72c43 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:35.654525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-084f98ab-cfa0-4540-aec5-4a885ef72c43 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:35.656503 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:35.661517 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-084f98ab-cfa0-4540-aec5-4a885ef72c43 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:35.661967 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-084f98ab-cfa0-4540-aec5-4a885ef72c43 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:35.662746 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-084f98ab-cfa0-4540-aec5-4a885ef72c43 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:35.663191 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-084f98ab-cfa0-4540-aec5-4a885ef72c43 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:35.857276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-084f98ab-cfa0-4540-aec5-4a885ef72c43 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:35.866038 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-084f98ab-cfa0-4540-aec5-4a885ef72c43 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.216094 Jun 08 13:48:35.866638 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 116/225] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:35 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:36.883103 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2cda93f7-e294-494c-b834-5fcec820c3df tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:36.883708 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2cda93f7-e294-494c-b834-5fcec820c3df tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:36.893692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2cda93f7-e294-494c-b834-5fcec820c3df tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:36.894356 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2cda93f7-e294-494c-b834-5fcec820c3df tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:36.895137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2cda93f7-e294-494c-b834-5fcec820c3df tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:36.895663 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2cda93f7-e294-494c-b834-5fcec820c3df tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:37.067019 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2cda93f7-e294-494c-b834-5fcec820c3df tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:37.078472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2cda93f7-e294-494c-b834-5fcec820c3df tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.199158 Jun 08 13:48:37.082063 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 110/226] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:36 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:37.150347 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6eef648e-0b74-4bc8-af54-939d4512a018 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:37.150836 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6eef648e-0b74-4bc8-af54-939d4512a018 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:37.157189 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6eef648e-0b74-4bc8-af54-939d4512a018 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:37.157631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6eef648e-0b74-4bc8-af54-939d4512a018 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:37.158385 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6eef648e-0b74-4bc8-af54-939d4512a018 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:37.158822 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6eef648e-0b74-4bc8-af54-939d4512a018 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:37.184519 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6eef648e-0b74-4bc8-af54-939d4512a018 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/ips" status: 200 len: 149 microversion: 2.20 time: 0.040636 Jun 08 13:48:37.185330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 117/227] 10.222.0.55 () {60 vars in 1288 bytes} [Wed Jun 8 13:48:37 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:48:38.100473 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c1bd06bb-e9b6-4ca5-9923-190d391aaff6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:38.101082 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c1bd06bb-e9b6-4ca5-9923-190d391aaff6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:38.110979 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c1bd06bb-e9b6-4ca5-9923-190d391aaff6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:38.111431 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c1bd06bb-e9b6-4ca5-9923-190d391aaff6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:38.113571 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c1bd06bb-e9b6-4ca5-9923-190d391aaff6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:38.114351 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c1bd06bb-e9b6-4ca5-9923-190d391aaff6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:38.269586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c1bd06bb-e9b6-4ca5-9923-190d391aaff6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:38.277118 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c1bd06bb-e9b6-4ca5-9923-190d391aaff6 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.182468 Jun 08 13:48:38.277884 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 111/228] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:38 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:39.299580 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9cdd3f3e-0e5b-46c7-9fd4-13a04e974fec tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:39.303833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9cdd3f3e-0e5b-46c7-9fd4-13a04e974fec tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:39.308040 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9cdd3f3e-0e5b-46c7-9fd4-13a04e974fec tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:39.308648 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9cdd3f3e-0e5b-46c7-9fd4-13a04e974fec tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:39.309532 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9cdd3f3e-0e5b-46c7-9fd4-13a04e974fec tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:39.310152 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9cdd3f3e-0e5b-46c7-9fd4-13a04e974fec tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:39.467599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9cdd3f3e-0e5b-46c7-9fd4-13a04e974fec tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:39.479887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9cdd3f3e-0e5b-46c7-9fd4-13a04e974fec tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.183925 Jun 08 13:48:39.491025 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 118/229] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:39 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:39.571975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-31d184a6-3d4c-4b3d-9235-c66e54b11314 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f2cee6e-2a43-4622-ba09-20a179d65d38"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:39.573071 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-31d184a6-3d4c-4b3d-9235-c66e54b11314 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:39.579971 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31d184a6-3d4c-4b3d-9235-c66e54b11314 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:39.580622 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31d184a6-3d4c-4b3d-9235-c66e54b11314 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:39.581943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31d184a6-3d4c-4b3d-9235-c66e54b11314 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:39.582500 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31d184a6-3d4c-4b3d-9235-c66e54b11314 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:40.498386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-89653a87-77ed-49cf-bf7e-6597d6ff7bb8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:40.499857 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-89653a87-77ed-49cf-bf7e-6597d6ff7bb8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:40.507971 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-89653a87-77ed-49cf-bf7e-6597d6ff7bb8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:40.508482 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-89653a87-77ed-49cf-bf7e-6597d6ff7bb8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:40.509262 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-89653a87-77ed-49cf-bf7e-6597d6ff7bb8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:40.509728 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-89653a87-77ed-49cf-bf7e-6597d6ff7bb8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:40.680546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-89653a87-77ed-49cf-bf7e-6597d6ff7bb8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:40.690249 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-89653a87-77ed-49cf-bf7e-6597d6ff7bb8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1501 microversion: 2.1 time: 0.194764 Jun 08 13:48:40.690249 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 119/230] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:40 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:40.695374 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2f71f172-1dca-41cf-aed7-913b02af5e0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:40.696186 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2f71f172-1dca-41cf-aed7-913b02af5e0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:40.702823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f71f172-1dca-41cf-aed7-913b02af5e0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:40.703269 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f71f172-1dca-41cf-aed7-913b02af5e0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:40.704033 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f71f172-1dca-41cf-aed7-913b02af5e0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:40.704491 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f71f172-1dca-41cf-aed7-913b02af5e0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:40.726821 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-2f71f172-1dca-41cf-aed7-913b02af5e0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lazy-loading 'flavor' on Instance uuid ac779098-8aa5-40b8-ae7d-dc4e463f015b {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:48:40.795565 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-31d184a6-3d4c-4b3d-9235-c66e54b11314 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.227298 Jun 08 13:48:40.798872 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 112/231] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:48:39 2022] POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/os-volume_attachments => generated 194 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:48:40.806473 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a69f914-02d6-43c8-bcd6-93b78ac32fa2"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:40.808771 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:40.818805 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:40.819726 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:40.820557 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:40.821062 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] HTTP exception thrown: Cannot 'attach_volume' instance b6ff0599-d152-4940-9811-f1187ab922e0 while it is in vm_state rescued Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Request method failure captured: Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: POST /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0/os-volume_attachments HTTP/1.1 Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 74 Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKhWmfjOgbqK2CSJHSTKHI6IveJnrM8w8UarJX_JvlVysiZhXg0V18KvvGG7aQd3UMsLFAxPtqLUvG2Maio6jvXsfWlGOgxowjEe9EDmba_uZYDLft_fZhEENfYo3NaDrW-mUQ0ZlWIC2i-YGG46CWiTxjeCvMUZ7p4mPis_UMDRHL8 Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:48:40.860919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9abd79bc99784c3f81991d1cae37a074", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}] Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 85e0d647620a407cbe03d83c86111f3d Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {"volumeAttachment": {"volumeId": "6a69f914-02d6-43c8-bcd6-93b78ac32fa2"}} Jun 08 13:48:40.863078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Cannot 'attach_volume' instance b6ff0599-d152-4940-9811-f1187ab922e0 while it is in vm_state rescued Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'server_id': 'b6ff0599-d152-4940-9811-f1187ab922e0', 'body': {'volumeAttachment': {'volumeId': '6a69f914-02d6-43c8-bcd6-93b78ac32fa2'}}} Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b6ff0599-d152-4940-9811-f1187ab922e0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:48:40.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b6ff0599-d152-4940-9811-f1187ab922e0 while it is in vm_state rescued Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:48:40.866015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:48:40.867396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:48:40.867396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:48:40.867396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b6ff0599-d152-4940-9811-f1187ab922e0 while it is in vm_state rescued Jun 08 13:48:40.867396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:48:40.867396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Returning 409 to user: Cannot 'attach_volume' instance b6ff0599-d152-4940-9811-f1187ab922e0 while it is in vm_state rescued {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:48:40.867396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f1f7108e-f6eb-4c03-a435-4e69c7fed9ef tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057592 Jun 08 13:48:40.867396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 113/232] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:48:40 2022] POST /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 08 13:48:40.868101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ec1f0517-590f-4cab-b45e-c8f91cf24586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:40.868663 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ec1f0517-590f-4cab-b45e-c8f91cf24586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:40.875034 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ec1f0517-590f-4cab-b45e-c8f91cf24586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:40.875559 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ec1f0517-590f-4cab-b45e-c8f91cf24586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:40.876473 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ec1f0517-590f-4cab-b45e-c8f91cf24586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:40.876987 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ec1f0517-590f-4cab-b45e-c8f91cf24586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:41.151177 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ec1f0517-590f-4cab-b45e-c8f91cf24586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0/action" status: 202 len: 0 microversion: 2.1 time: 0.290478 Jun 08 13:48:41.154926 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 114/233] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:48:40 2022] POST /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 13:48:41.161357 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5908fa66-b786-4c66-8049-24b1e937bb23 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:41.162065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5908fa66-b786-4c66-8049-24b1e937bb23 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:41.169750 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5908fa66-b786-4c66-8049-24b1e937bb23 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:41.170203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5908fa66-b786-4c66-8049-24b1e937bb23 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:41.170981 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5908fa66-b786-4c66-8049-24b1e937bb23 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:41.171420 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5908fa66-b786-4c66-8049-24b1e937bb23 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:41.317672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5908fa66-b786-4c66-8049-24b1e937bb23 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:41.325659 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5908fa66-b786-4c66-8049-24b1e937bb23 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1509 microversion: 2.1 time: 0.169306 Jun 08 13:48:41.326444 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 115/234] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:41 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:42.343480 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2284837a-5acb-4ca8-b78a-b0021097b660 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:42.344847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2284837a-5acb-4ca8-b78a-b0021097b660 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:42.353224 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2284837a-5acb-4ca8-b78a-b0021097b660 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:42.353892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2284837a-5acb-4ca8-b78a-b0021097b660 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:42.354717 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2284837a-5acb-4ca8-b78a-b0021097b660 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:42.355159 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2284837a-5acb-4ca8-b78a-b0021097b660 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:42.511351 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2284837a-5acb-4ca8-b78a-b0021097b660 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:42.520340 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2284837a-5acb-4ca8-b78a-b0021097b660 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1509 microversion: 2.1 time: 0.180428 Jun 08 13:48:42.529719 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 116/235] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:42 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:42.677668 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2f71f172-1dca-41cf-aed7-913b02af5e0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/action" status: 202 len: 0 microversion: 2.20 time: 1.985647 Jun 08 13:48:42.678527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 120/236] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 8 13:48:40 2022] POST /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/action => generated 0 bytes in 1989 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:48:42.686768 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:42.687370 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:42.693379 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:42.693829 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:42.694578 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:42.695009 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:42.823494 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:42.831879 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:42.833450 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:42.834620 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2487a7b0-6e0d-4a94-8d7a-338961885fff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.151689 Jun 08 13:48:42.835282 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 117/237] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:42 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:48:43.538096 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7664f974-14ef-49f4-84a6-bb2251dd347c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:43.538869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7664f974-14ef-49f4-84a6-bb2251dd347c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:43.546296 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7664f974-14ef-49f4-84a6-bb2251dd347c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:43.551392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7664f974-14ef-49f4-84a6-bb2251dd347c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:43.551392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7664f974-14ef-49f4-84a6-bb2251dd347c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:43.551392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7664f974-14ef-49f4-84a6-bb2251dd347c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:43.688873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7664f974-14ef-49f4-84a6-bb2251dd347c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:43.697131 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7664f974-14ef-49f4-84a6-bb2251dd347c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1509 microversion: 2.1 time: 0.163189 Jun 08 13:48:43.697703 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 121/238] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:43 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:43.854867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:43.855487 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:43.857904 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=44 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:43.863924 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:43.864756 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:43.865272 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:43.865717 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:44.010583 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:44.019202 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:44.020535 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:44.022067 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2377abce-53b3-4769-8a54-fb32d068fa3a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.170830 Jun 08 13:48:44.034259 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 118/239] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:43 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:48:44.715168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-643e6e5d-5108-4294-a872-ead7094e38cc tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:44.715878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-643e6e5d-5108-4294-a872-ead7094e38cc tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:44.723109 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-643e6e5d-5108-4294-a872-ead7094e38cc tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:44.723552 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-643e6e5d-5108-4294-a872-ead7094e38cc tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:44.724349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-643e6e5d-5108-4294-a872-ead7094e38cc tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:44.724786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-643e6e5d-5108-4294-a872-ead7094e38cc tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:44.863731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-643e6e5d-5108-4294-a872-ead7094e38cc tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:44.871427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-643e6e5d-5108-4294-a872-ead7094e38cc tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1515 microversion: 2.1 time: 0.160263 Jun 08 13:48:44.873173 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 122/240] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:44 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:45.042270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:45.043509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:45.050713 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:45.052232 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:45.053033 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:45.053619 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:45.198509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:45.207278 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:45.209533 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:45.210102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8756b30b-99f9-491c-92d3-8ad6822fbfae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.172051 Jun 08 13:48:45.210655 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 119/241] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:45 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:48:46.229205 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:46.229849 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:46.236593 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:46.242942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:46.242942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:46.242942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:46.371467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:46.379605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:46.381118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:46.382268 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-29ba1db2-c5cd-4618-8bf2-fedfee5d2726 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.156999 Jun 08 13:48:46.382822 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 123/242] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:46 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:48:46.546156 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-76a359b4-3089-4887-a232-231857d2703b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'create', calling method: .version_select at 0x7fe2896e1820>, body: {"keypair": {"name": "tempest-keypair-264101866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGD4LlcPVzfSwP+2iVB1xG4BHXuJ1ifLWBWcVWBzokgLaMDLALfZRTD0bT0bcTTtA1OAx14ikXgiKhqxgvVmM4FtT4YcReZ/eMnESOW9VaM6t7oshoauHwK5nEVEGaioKQ=="}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:46.560922 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-76a359b4-3089-4887-a232-231857d2703b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Getting quotas for project 9abd79bc99784c3f81991d1cae37a074. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:48:46.564716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-76a359b4-3089-4887-a232-231857d2703b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Getting quotas for user 85e0d647620a407cbe03d83c86111f3d and project 9abd79bc99784c3f81991d1cae37a074. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:48:46.691583 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-76a359b4-3089-4887-a232-231857d2703b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149237 Jun 08 13:48:46.692377 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 120/243] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 13:48:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:48:47.400663 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:47.401274 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:47.407547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:47.407994 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:47.426012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:47.426012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:47.572234 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:47.585802 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:47.587569 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:47.589791 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f3da12e0-9d02-43f2-b4fa-61a915c10f4a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.193386 Jun 08 13:48:47.590629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 124/244] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:47 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:48:48.610047 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:48.610661 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:48.620979 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:48.621315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:48.622088 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:48.622533 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:48.908678 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:48.917510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:48.919030 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:48.920261 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-58985d18-5c11-459d-97b8-2c3e5604d6ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.314811 Jun 08 13:48:48.921316 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 121/245] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:48 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:48:49.294221 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-14387657-91fa-4b4b-8589-1a40f409a157 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75884dc5-44a2-4fa9-a185-25926645918e", "device": "/dev/sdb"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:49.297127 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-14387657-91fa-4b4b-8589-1a40f409a157 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:49.308075 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-14387657-91fa-4b4b-8589-1a40f409a157 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:49.308556 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-14387657-91fa-4b4b-8589-1a40f409a157 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:49.309774 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-14387657-91fa-4b4b-8589-1a40f409a157 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:49.311035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-14387657-91fa-4b4b-8589-1a40f409a157 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:49.550758 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8fef22cc-5452-4a57-882c-c0509be523bf tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:49.557940 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fef22cc-5452-4a57-882c-c0509be523bf tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:49.559871 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fef22cc-5452-4a57-882c-c0509be523bf tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:49.636332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8fef22cc-5452-4a57-882c-c0509be523bf tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Going to try to stop instance {{(pid=124628) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 08 13:48:49.920729 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8fef22cc-5452-4a57-882c-c0509be523bf tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/action" status: 202 len: 0 microversion: 2.1 time: 0.373763 Jun 08 13:48:49.921413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 122/246] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:48:49 2022] POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 13:48:49.939584 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-203909560", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae8a0e1e-0700-4e0e-8372-c30751bbef6f"}], "security_groups": [{"name": "tempest-securitygroup--1942505347"}], "key_name": "tempest-keypair-264101866", "user_data": "}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:50.058265 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] validate_networks() for [('ae8a0e1e-0700-4e0e-8372-c30751bbef6f', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:48:50.411977 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-14387657-91fa-4b4b-8589-1a40f409a157 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "POST /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124076 Jun 08 13:48:50.412955 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 125/247] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:48:49 2022] POST /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4/os-volume_attachments => generated 194 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:48:50.419785 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a6093801-cb4c-43c3-a344-efe8e02caed6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:50.421184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a6093801-cb4c-43c3-a344-efe8e02caed6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:50.432595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a6093801-cb4c-43c3-a344-efe8e02caed6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:50.433341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a6093801-cb4c-43c3-a344-efe8e02caed6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:50.434254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a6093801-cb4c-43c3-a344-efe8e02caed6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:50.434767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a6093801-cb4c-43c3-a344-efe8e02caed6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:50.541903 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:48:50.542329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:48:50.542809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:48:50.543303 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:48:50.543822 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:48:50.557244 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:50.557702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:50.561270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:50.561735 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:50.586458 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Getting quotas for project 9abd79bc99784c3f81991d1cae37a074. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:48:50.594519 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Getting quotas for user 85e0d647620a407cbe03d83c86111f3d and project 9abd79bc99784c3f81991d1cae37a074. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:48:50.609466 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:48:50.617851 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:48:50.647133 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a6093801-cb4c-43c3-a344-efe8e02caed6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:50.655753 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a6093801-cb4c-43c3-a344-efe8e02caed6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.241362 Jun 08 13:48:50.656370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 126/248] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:50 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:50.664904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:50.664904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:50.668680 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:50.669129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:50.669954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:50.670392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:50.675863 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:50.809502 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:50.819426 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:50.820297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:50.822516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8acc593c-8a59-4493-9d9f-cc73d2541a0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.164104 Jun 08 13:48:50.823092 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 127/249] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:50 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:48:50.834012 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1f4d487a-b6a7-43f9-9a95-c8d7c82b9066 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.899040 Jun 08 13:48:50.843311 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 123/250] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:48:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:48:50.854310 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6655ec18-6925-4c48-b29a-120e7f272848 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:50.855078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6655ec18-6925-4c48-b29a-120e7f272848 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:50.910389 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6655ec18-6925-4c48-b29a-120e7f272848 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:50.917427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6655ec18-6925-4c48-b29a-120e7f272848 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1244 microversion: 2.1 time: 0.067043 Jun 08 13:48:50.918025 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 128/251] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:50 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:51.675616 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6fcbfc7f-0f89-4f8d-9bd5-799943ae116a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:51.676410 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6fcbfc7f-0f89-4f8d-9bd5-799943ae116a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:51.683609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6fcbfc7f-0f89-4f8d-9bd5-799943ae116a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:51.687848 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6fcbfc7f-0f89-4f8d-9bd5-799943ae116a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:51.687848 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6fcbfc7f-0f89-4f8d-9bd5-799943ae116a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:51.687848 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6fcbfc7f-0f89-4f8d-9bd5-799943ae116a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:51.841325 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6fcbfc7f-0f89-4f8d-9bd5-799943ae116a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:51.842075 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:51.842716 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:51.851863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6fcbfc7f-0f89-4f8d-9bd5-799943ae116a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.181925 Jun 08 13:48:51.852188 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:51.852478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 124/252] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:51 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:51.852684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:51.853487 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:51.854116 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:51.935541 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d286afda-24d9-4a7e-aa2f-d48b25d5db8e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:51.936340 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d286afda-24d9-4a7e-aa2f-d48b25d5db8e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:51.949415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d286afda-24d9-4a7e-aa2f-d48b25d5db8e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:51.949415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d286afda-24d9-4a7e-aa2f-d48b25d5db8e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:51.949415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d286afda-24d9-4a7e-aa2f-d48b25d5db8e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:51.949415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d286afda-24d9-4a7e-aa2f-d48b25d5db8e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:51.952093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:48:52.023169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:52.028927 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d286afda-24d9-4a7e-aa2f-d48b25d5db8e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:52.031325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:52.032953 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:52.034880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b29d144a-a7d4-4359-b5fc-07de4556b0d7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.196489 Jun 08 13:48:52.038033 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d286afda-24d9-4a7e-aa2f-d48b25d5db8e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1248 microversion: 2.1 time: 0.106405 Jun 08 13:48:52.038618 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 125/253] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:51 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1248 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:52.047652 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 129/254] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:51 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:48:52.870359 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-14260686-b571-4a86-897d-e169583c3a02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:52.870975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-14260686-b571-4a86-897d-e169583c3a02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:52.876916 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-14260686-b571-4a86-897d-e169583c3a02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:52.877370 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-14260686-b571-4a86-897d-e169583c3a02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:52.878198 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-14260686-b571-4a86-897d-e169583c3a02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:52.878635 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-14260686-b571-4a86-897d-e169583c3a02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:53.021540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-14260686-b571-4a86-897d-e169583c3a02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:53.030575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-14260686-b571-4a86-897d-e169583c3a02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.165672 Jun 08 13:48:53.041399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 126/255] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:52 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:53.054867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:53.055476 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:53.057087 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-20c56de3-58d6-4b7f-99da-d35ffb650255 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:53.057668 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-20c56de3-58d6-4b7f-99da-d35ffb650255 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:53.063724 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:53.064039 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20c56de3-58d6-4b7f-99da-d35ffb650255 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:53.064510 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:53.064728 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20c56de3-58d6-4b7f-99da-d35ffb650255 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:53.065757 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:53.065944 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20c56de3-58d6-4b7f-99da-d35ffb650255 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:53.066235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20c56de3-58d6-4b7f-99da-d35ffb650255 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:53.066348 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:53.167189 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-20c56de3-58d6-4b7f-99da-d35ffb650255 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:53.178169 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-20c56de3-58d6-4b7f-99da-d35ffb650255 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1296 microversion: 2.1 time: 0.124832 Jun 08 13:48:53.179826 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 127/256] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:53 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1296 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:53.233951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:53.242787 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:53.244323 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:53.245477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5376475a-7ba1-4704-8b90-a12dfea7d331 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.194615 Jun 08 13:48:53.246042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 130/257] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:53 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:48:54.048935 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9a6f8178-9afc-4620-868b-a0be0238855d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:54.049722 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-9a6f8178-9afc-4620-868b-a0be0238855d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:54.056735 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9a6f8178-9afc-4620-868b-a0be0238855d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:54.057185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9a6f8178-9afc-4620-868b-a0be0238855d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:54.057946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9a6f8178-9afc-4620-868b-a0be0238855d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:54.058384 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9a6f8178-9afc-4620-868b-a0be0238855d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:54.188072 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-9a6f8178-9afc-4620-868b-a0be0238855d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:54.196195 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1f731259-f0ff-447a-a5a3-bc155792292d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:54.196801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1f731259-f0ff-447a-a5a3-bc155792292d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:54.196908 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9a6f8178-9afc-4620-868b-a0be0238855d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.152225 Jun 08 13:48:54.197485 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 128/258] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:54 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:54.203812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f731259-f0ff-447a-a5a3-bc155792292d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:54.204288 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f731259-f0ff-447a-a5a3-bc155792292d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:54.205055 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f731259-f0ff-447a-a5a3-bc155792292d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:54.205549 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f731259-f0ff-447a-a5a3-bc155792292d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:54.264085 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:54.264809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:54.268314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1f731259-f0ff-447a-a5a3-bc155792292d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:54.271518 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:54.271964 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:54.272773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:54.273218 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:54.276040 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1f731259-f0ff-447a-a5a3-bc155792292d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1304 microversion: 2.1 time: 0.083697 Jun 08 13:48:54.276715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 131/259] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:54 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:54.403405 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:54.411263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:54.412827 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:54.413978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-33ab9325-2a86-43da-ae76-f8a9399d096e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.154021 Jun 08 13:48:54.414530 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 129/260] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:54 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:48:55.214664 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d4de7dc7-2916-427c-88bf-d54c97c4b28b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:55.215268 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d4de7dc7-2916-427c-88bf-d54c97c4b28b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:55.222571 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d4de7dc7-2916-427c-88bf-d54c97c4b28b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:55.223012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d4de7dc7-2916-427c-88bf-d54c97c4b28b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:55.223762 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d4de7dc7-2916-427c-88bf-d54c97c4b28b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:55.224230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d4de7dc7-2916-427c-88bf-d54c97c4b28b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:55.293179 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0bca974f-1fc4-4acb-99dd-a00afc7ff3f7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:55.293795 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0bca974f-1fc4-4acb-99dd-a00afc7ff3f7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:55.300249 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0bca974f-1fc4-4acb-99dd-a00afc7ff3f7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:55.301194 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0bca974f-1fc4-4acb-99dd-a00afc7ff3f7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:55.301458 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0bca974f-1fc4-4acb-99dd-a00afc7ff3f7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:55.301899 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0bca974f-1fc4-4acb-99dd-a00afc7ff3f7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:55.374991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0bca974f-1fc4-4acb-99dd-a00afc7ff3f7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:55.379713 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d4de7dc7-2916-427c-88bf-d54c97c4b28b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:55.383175 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0bca974f-1fc4-4acb-99dd-a00afc7ff3f7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1304 microversion: 2.1 time: 0.093801 Jun 08 13:48:55.383744 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 130/261] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:55 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:55.387913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d4de7dc7-2916-427c-88bf-d54c97c4b28b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.177039 Jun 08 13:48:55.388505 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 132/262] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:55 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:55.432532 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:55.433133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:55.438985 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:55.439434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:55.440759 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:55.441201 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:55.568114 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:55.576008 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:55.577462 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:55.578602 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f833da2e-fe45-4172-bf45-d8d09f922408 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.149794 Jun 08 13:48:55.579167 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 131/263] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:55 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:48:56.399702 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e5379ea9-1d36-4634-8a00-7c537c33abff tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:56.400414 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e5379ea9-1d36-4634-8a00-7c537c33abff tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:56.405065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-15e6f59f-740f-470c-8784-528f250ae097 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:56.405672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-15e6f59f-740f-470c-8784-528f250ae097 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:56.407117 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5379ea9-1d36-4634-8a00-7c537c33abff tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:56.407568 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5379ea9-1d36-4634-8a00-7c537c33abff tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:56.408356 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5379ea9-1d36-4634-8a00-7c537c33abff tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:56.409396 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5379ea9-1d36-4634-8a00-7c537c33abff tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:56.413088 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-15e6f59f-740f-470c-8784-528f250ae097 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:56.413646 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-15e6f59f-740f-470c-8784-528f250ae097 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:56.414536 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-15e6f59f-740f-470c-8784-528f250ae097 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:56.415044 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-15e6f59f-740f-470c-8784-528f250ae097 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:56.479410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e5379ea9-1d36-4634-8a00-7c537c33abff tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:56.487154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e5379ea9-1d36-4634-8a00-7c537c33abff tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1314 microversion: 2.1 time: 0.091135 Jun 08 13:48:56.487731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 133/264] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:56 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1314 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:56.567178 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-15e6f59f-740f-470c-8784-528f250ae097 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:56.575250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-15e6f59f-740f-470c-8784-528f250ae097 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.173810 Jun 08 13:48:56.575758 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 132/265] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:56 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:56.597887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:56.598493 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:56.604541 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:56.604981 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:56.605740 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:56.606168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:56.733711 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:56.741960 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:56.743486 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:56.744688 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-95e6f4dc-d391-482b-8b3a-288f7eb823b5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.151341 Jun 08 13:48:56.745256 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 134/266] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:56 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:48:57.505245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e981ec23-943f-41f0-8dee-e06f26219d6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:57.506497 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e981ec23-943f-41f0-8dee-e06f26219d6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:57.512885 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e981ec23-943f-41f0-8dee-e06f26219d6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:57.513338 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e981ec23-943f-41f0-8dee-e06f26219d6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:57.514100 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e981ec23-943f-41f0-8dee-e06f26219d6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:57.514531 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e981ec23-943f-41f0-8dee-e06f26219d6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:57.577085 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e981ec23-943f-41f0-8dee-e06f26219d6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:57.585031 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e981ec23-943f-41f0-8dee-e06f26219d6f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1302 microversion: 2.1 time: 0.084239 Jun 08 13:48:57.585649 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 133/267] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:57 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:57.599370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4aebcb03-0c0b-4eed-9583-e5db0a0b92be tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:57.599992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4aebcb03-0c0b-4eed-9583-e5db0a0b92be tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:57.606036 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4aebcb03-0c0b-4eed-9583-e5db0a0b92be tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:57.606417 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4aebcb03-0c0b-4eed-9583-e5db0a0b92be tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:57.607226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4aebcb03-0c0b-4eed-9583-e5db0a0b92be tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:57.607837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4aebcb03-0c0b-4eed-9583-e5db0a0b92be tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:57.762741 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:57.763698 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:57.774159 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4aebcb03-0c0b-4eed-9583-e5db0a0b92be tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:57.777589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:57.778261 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:57.779068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:57.779529 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:57.784164 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4aebcb03-0c0b-4eed-9583-e5db0a0b92be tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.194018 Jun 08 13:48:57.784936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 135/268] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:57 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:57.934636 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:57.943577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:57.951925 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:57.953212 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e0a6e9d0-0672-4226-9399-99aa5b63930e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.194432 Jun 08 13:48:57.953780 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 134/269] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:57 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:48:58.602837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d71bcac5-86ed-4b60-8e16-6df2fdbae586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:58.603454 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d71bcac5-86ed-4b60-8e16-6df2fdbae586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:58.609866 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d71bcac5-86ed-4b60-8e16-6df2fdbae586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:58.610313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d71bcac5-86ed-4b60-8e16-6df2fdbae586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:58.611079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d71bcac5-86ed-4b60-8e16-6df2fdbae586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:58.611533 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d71bcac5-86ed-4b60-8e16-6df2fdbae586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:58.647725 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-982b7e71-0cba-448c-a860-f1b1111d7dd7 req-49347104-02fc-4492-9676-677de2ac1bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777c65ea-2412-4080-9c2c-ee5201184c1e", "tag": "d1b9ce5f-7ee5-4967-93f0-2a76e3005b21"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:48:58.671396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-982b7e71-0cba-448c-a860-f1b1111d7dd7 req-49347104-02fc-4492-9676-677de2ac1bf6 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:58.672615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-982b7e71-0cba-448c-a860-f1b1111d7dd7 req-49347104-02fc-4492-9676-677de2ac1bf6 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:58.696322 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-982b7e71-0cba-448c-a860-f1b1111d7dd7 req-49347104-02fc-4492-9676-677de2ac1bf6 service nova] Creating event network-changed:d1b9ce5f-7ee5-4967-93f0-2a76e3005b21 for instance 777c65ea-2412-4080-9c2c-ee5201184c1e on hv-cinder-81914 Jun 08 13:48:58.697934 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-982b7e71-0cba-448c-a860-f1b1111d7dd7 req-49347104-02fc-4492-9676-677de2ac1bf6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057353 Jun 08 13:48:58.698785 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 135/270] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:48:58.785942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d71bcac5-86ed-4b60-8e16-6df2fdbae586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:58.793935 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d71bcac5-86ed-4b60-8e16-6df2fdbae586 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.194910 Jun 08 13:48:58.795753 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 136/271] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:58 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:48:58.806055 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e2b6c8d4-f894-48b2-bbb6-f174942a4aa2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:58.807784 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e2b6c8d4-f894-48b2-bbb6-f174942a4aa2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:58.818644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e2b6c8d4-f894-48b2-bbb6-f174942a4aa2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:58.819107 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e2b6c8d4-f894-48b2-bbb6-f174942a4aa2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:58.819900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e2b6c8d4-f894-48b2-bbb6-f174942a4aa2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:58.820400 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e2b6c8d4-f894-48b2-bbb6-f174942a4aa2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:58.973603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:58.974406 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:58.980813 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:58.981503 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:58.982270 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:58.982853 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:58.999982 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e2b6c8d4-f894-48b2-bbb6-f174942a4aa2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:59.010185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e2b6c8d4-f894-48b2-bbb6-f174942a4aa2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.207691 Jun 08 13:48:59.021476 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 136/272] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:58 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:48:59.129729 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:59.138150 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:59.139730 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:59.140932 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9e397aca-2e6a-4705-b3b8-df1dee0ee696 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.172294 Jun 08 13:48:59.142231 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 137/273] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:48:58 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:48:59.811055 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0f6eee2d-9b9c-47a0-b798-47efa806511f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:48:59.811679 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0f6eee2d-9b9c-47a0-b798-47efa806511f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:48:59.818379 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0f6eee2d-9b9c-47a0-b798-47efa806511f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:59.818833 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0f6eee2d-9b9c-47a0-b798-47efa806511f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:59.819602 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0f6eee2d-9b9c-47a0-b798-47efa806511f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:48:59.820070 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0f6eee2d-9b9c-47a0-b798-47efa806511f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:48:59.964647 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0f6eee2d-9b9c-47a0-b798-47efa806511f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:48:59.972323 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0f6eee2d-9b9c-47a0-b798-47efa806511f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.165182 Jun 08 13:48:59.974146 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 137/274] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:48:59 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:00.027488 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e6697c93-28cb-4bfd-8146-2d8a93188014 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:00.028027 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e6697c93-28cb-4bfd-8146-2d8a93188014 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:00.034692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e6697c93-28cb-4bfd-8146-2d8a93188014 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:00.035313 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e6697c93-28cb-4bfd-8146-2d8a93188014 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:00.036118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e6697c93-28cb-4bfd-8146-2d8a93188014 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:00.036563 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e6697c93-28cb-4bfd-8146-2d8a93188014 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:00.159808 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:00.160438 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:00.166491 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:00.166944 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:00.167702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:00.168160 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:00.175593 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e6697c93-28cb-4bfd-8146-2d8a93188014 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:00.183387 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e6697c93-28cb-4bfd-8146-2d8a93188014 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.159991 Jun 08 13:49:00.184232 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 138/275] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:00 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:00.298778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:00.307466 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:00.309017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:00.310353 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b83cb7c4-d29b-42a9-9f18-33796afc507b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.154961 Jun 08 13:49:00.310910 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 138/276] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:00 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:00.989351 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-45ddd6c9-e1a4-4e04-b625-132cf0a4fa18 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:00.989964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-45ddd6c9-e1a4-4e04-b625-132cf0a4fa18 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:00.991851 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:00.996938 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-45ddd6c9-e1a4-4e04-b625-132cf0a4fa18 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:00.997382 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-45ddd6c9-e1a4-4e04-b625-132cf0a4fa18 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:01.000773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-45ddd6c9-e1a4-4e04-b625-132cf0a4fa18 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:01.000773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-45ddd6c9-e1a4-4e04-b625-132cf0a4fa18 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:01.171520 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-45ddd6c9-e1a4-4e04-b625-132cf0a4fa18 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:01.179305 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-45ddd6c9-e1a4-4e04-b625-132cf0a4fa18 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.193970 Jun 08 13:49:01.180142 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 139/277] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:00 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:01.200755 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-06c3c10c-23b9-4663-8169-b938209d6bf1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:01.201377 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-06c3c10c-23b9-4663-8169-b938209d6bf1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:01.203390 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:01.204088 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=10 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:01.209927 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-06c3c10c-23b9-4663-8169-b938209d6bf1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:01.210380 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-06c3c10c-23b9-4663-8169-b938209d6bf1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:01.211153 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-06c3c10c-23b9-4663-8169-b938209d6bf1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:01.211593 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-06c3c10c-23b9-4663-8169-b938209d6bf1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:01.329374 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:01.329991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:01.337892 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:01.338344 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:01.339126 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:01.339567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:01.399388 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-06c3c10c-23b9-4663-8169-b938209d6bf1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:01.407818 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-06c3c10c-23b9-4663-8169-b938209d6bf1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.210986 Jun 08 13:49:01.408754 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 139/278] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:01 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:01.488087 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:01.496573 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:01.498092 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:01.499348 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-27bab5a6-974d-4fe7-805d-62886bb384ac tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.173935 Jun 08 13:49:01.499921 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 140/279] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:01 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:02.198916 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e4efc99e-4826-4f7b-adea-bfce4c56198b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:02.199521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e4efc99e-4826-4f7b-adea-bfce4c56198b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:02.207751 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e4efc99e-4826-4f7b-adea-bfce4c56198b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:02.207751 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e4efc99e-4826-4f7b-adea-bfce4c56198b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:02.207751 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e4efc99e-4826-4f7b-adea-bfce4c56198b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:02.207751 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e4efc99e-4826-4f7b-adea-bfce4c56198b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:02.387267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e4efc99e-4826-4f7b-adea-bfce4c56198b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:02.394772 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e4efc99e-4826-4f7b-adea-bfce4c56198b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.200174 Jun 08 13:49:02.395332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 140/280] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:02 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:02.425307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-229145c1-989e-451e-8ea6-18b8e923ca8d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:02.425981 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-229145c1-989e-451e-8ea6-18b8e923ca8d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:02.432664 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-229145c1-989e-451e-8ea6-18b8e923ca8d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:02.433119 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-229145c1-989e-451e-8ea6-18b8e923ca8d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:02.433891 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-229145c1-989e-451e-8ea6-18b8e923ca8d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:02.434332 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-229145c1-989e-451e-8ea6-18b8e923ca8d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:02.518678 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:02.519576 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:02.525767 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:02.526383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:02.527147 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:02.527579 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:02.614528 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-229145c1-989e-451e-8ea6-18b8e923ca8d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:02.622579 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-229145c1-989e-451e-8ea6-18b8e923ca8d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.201771 Jun 08 13:49:02.623150 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 141/281] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:02 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:02.681988 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:02.690533 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:02.692355 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:02.693233 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-31305628-86f4-4a13-bd6f-44d3b89f363e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.178770 Jun 08 13:49:02.694069 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 141/282] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:02 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:03.411703 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-29594f13-731a-46ef-8bb1-0285f02cb3ce tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:03.412442 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-29594f13-731a-46ef-8bb1-0285f02cb3ce tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:03.418566 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29594f13-731a-46ef-8bb1-0285f02cb3ce tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:03.419087 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29594f13-731a-46ef-8bb1-0285f02cb3ce tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:03.419860 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29594f13-731a-46ef-8bb1-0285f02cb3ce tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:03.420320 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-29594f13-731a-46ef-8bb1-0285f02cb3ce tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:03.562529 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-29594f13-731a-46ef-8bb1-0285f02cb3ce tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:03.573281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-29594f13-731a-46ef-8bb1-0285f02cb3ce tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.166493 Jun 08 13:49:03.573859 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 142/283] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:03 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:03.640441 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ed5be035-4bb7-4576-9c34-46d8b23bf037 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:03.641063 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ed5be035-4bb7-4576-9c34-46d8b23bf037 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:03.648209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ed5be035-4bb7-4576-9c34-46d8b23bf037 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:03.648670 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ed5be035-4bb7-4576-9c34-46d8b23bf037 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:03.649428 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ed5be035-4bb7-4576-9c34-46d8b23bf037 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:03.649864 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ed5be035-4bb7-4576-9c34-46d8b23bf037 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:03.667407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=100 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:03.712526 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:03.713150 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:03.719348 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:03.719794 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:03.720676 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:03.721152 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:03.819056 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ed5be035-4bb7-4576-9c34-46d8b23bf037 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:03.828045 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ed5be035-4bb7-4576-9c34-46d8b23bf037 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.191528 Jun 08 13:49:03.828845 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 142/284] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:03 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:03.886228 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:03.895116 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:03.896736 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:03.898079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-40488a41-f60e-4358-8f15-0e13df61b9de tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.189591 Jun 08 13:49:03.898615 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 143/285] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:03 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:04.589789 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1b6417aa-298b-44ff-a353-0f8695866ec9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:04.590641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1b6417aa-298b-44ff-a353-0f8695866ec9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:04.597601 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1b6417aa-298b-44ff-a353-0f8695866ec9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:04.598059 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1b6417aa-298b-44ff-a353-0f8695866ec9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:04.598822 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1b6417aa-298b-44ff-a353-0f8695866ec9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:04.599254 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1b6417aa-298b-44ff-a353-0f8695866ec9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:04.847007 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-603a634e-1580-4053-833f-65cce2cebd2b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:04.847615 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-603a634e-1580-4053-833f-65cce2cebd2b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:04.855910 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-603a634e-1580-4053-833f-65cce2cebd2b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:04.856525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-603a634e-1580-4053-833f-65cce2cebd2b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:04.857555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-603a634e-1580-4053-833f-65cce2cebd2b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:04.857992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-603a634e-1580-4053-833f-65cce2cebd2b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:04.977913 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1b6417aa-298b-44ff-a353-0f8695866ec9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:04.986073 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1b6417aa-298b-44ff-a353-0f8695866ec9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.399993 Jun 08 13:49:04.987414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 143/286] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:04 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:04.993872 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:04.994641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:05.001470 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:05.002781 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:05.003534 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:05.003977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:05.030687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-603a634e-1580-4053-833f-65cce2cebd2b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:05.032881 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=100 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:05.039295 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-603a634e-1580-4053-833f-65cce2cebd2b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1699 microversion: 2.1 time: 0.196805 Jun 08 13:49:05.039949 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 144/287] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:04 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1699 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:49:05.068371 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c06a6ffa-1b79-4547-98cd-febd593604ef tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:05.074752 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c06a6ffa-1b79-4547-98cd-febd593604ef tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:05.075207 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c06a6ffa-1b79-4547-98cd-febd593604ef tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:05.141311 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c06a6ffa-1b79-4547-98cd-febd593604ef tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Going to try to start instance {{(pid=124629) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 08 13:49:05.148800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:05.157542 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:05.160651 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:05.162365 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1ff830ea-95a3-42d9-b5f2-02c5bd49e0a8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1741 microversion: 2.20 time: 0.173208 Jun 08 13:49:05.163283 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 144/288] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:04 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:05.387980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c06a6ffa-1b79-4547-98cd-febd593604ef tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/action" status: 202 len: 0 microversion: 2.1 time: 0.324231 Jun 08 13:49:05.388625 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 145/289] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:49:05 2022] POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 13:49:05.398914 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2a81c9e4-9746-4109-8dd9-c833f0015156 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:05.399530 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2a81c9e4-9746-4109-8dd9-c833f0015156 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:05.405597 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a81c9e4-9746-4109-8dd9-c833f0015156 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:05.406127 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a81c9e4-9746-4109-8dd9-c833f0015156 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:05.406976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a81c9e4-9746-4109-8dd9-c833f0015156 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:05.407415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a81c9e4-9746-4109-8dd9-c833f0015156 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:05.543367 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2a81c9e4-9746-4109-8dd9-c833f0015156 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:05.551884 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2a81c9e4-9746-4109-8dd9-c833f0015156 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1708 microversion: 2.1 time: 0.158023 Jun 08 13:49:05.552517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 145/290] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:05 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:06.004487 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-22b05481-de3b-453a-8e13-360765e779da tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:06.005179 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-22b05481-de3b-453a-8e13-360765e779da tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:06.011893 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-22b05481-de3b-453a-8e13-360765e779da tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:06.012373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-22b05481-de3b-453a-8e13-360765e779da tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:06.013128 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-22b05481-de3b-453a-8e13-360765e779da tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:06.013558 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-22b05481-de3b-453a-8e13-360765e779da tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:06.152433 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-22b05481-de3b-453a-8e13-360765e779da tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:06.160705 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-22b05481-de3b-453a-8e13-360765e779da tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.160393 Jun 08 13:49:06.161321 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 146/291] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:05 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:06.180984 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:06.181598 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:06.188383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:06.188834 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:06.190242 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:06.190685 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:06.323946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:06.332224 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:06.333818 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:06.334963 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ead86d14-cb2a-4fbf-8f43-19a938bed906 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1741 microversion: 2.20 time: 0.157974 Jun 08 13:49:06.335526 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 146/292] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:06 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:06.569713 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-cba3066a-f5bd-4677-8a74-9b5a980a7cfd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:06.570326 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-cba3066a-f5bd-4677-8a74-9b5a980a7cfd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:06.576493 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cba3066a-f5bd-4677-8a74-9b5a980a7cfd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:06.576952 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cba3066a-f5bd-4677-8a74-9b5a980a7cfd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:06.577717 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cba3066a-f5bd-4677-8a74-9b5a980a7cfd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:06.578155 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cba3066a-f5bd-4677-8a74-9b5a980a7cfd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:06.706365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-cba3066a-f5bd-4677-8a74-9b5a980a7cfd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:06.714222 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-cba3066a-f5bd-4677-8a74-9b5a980a7cfd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1708 microversion: 2.1 time: 0.148369 Jun 08 13:49:06.714789 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 147/293] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:06 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:07.176962 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-47e1de4f-75a0-46a7-84b7-19bad9d08f7b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:07.177499 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-47e1de4f-75a0-46a7-84b7-19bad9d08f7b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:07.183507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-47e1de4f-75a0-46a7-84b7-19bad9d08f7b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:07.184110 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-47e1de4f-75a0-46a7-84b7-19bad9d08f7b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:07.184737 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-47e1de4f-75a0-46a7-84b7-19bad9d08f7b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:07.185181 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-47e1de4f-75a0-46a7-84b7-19bad9d08f7b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:07.315903 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-47e1de4f-75a0-46a7-84b7-19bad9d08f7b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:07.323222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-47e1de4f-75a0-46a7-84b7-19bad9d08f7b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.150306 Jun 08 13:49:07.323784 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 147/294] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:07 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:07.353129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:07.353774 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:07.360165 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:07.360614 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:07.361453 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:07.361887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:07.487828 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:07.495644 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:07.497195 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:07.498382 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9a4fb05c-53c9-43d4-bcc0-db1b48d9536f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1741 microversion: 2.20 time: 0.149135 Jun 08 13:49:07.498964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 148/295] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:07 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1741 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:07.733793 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8e3d23c3-cd42-4d3d-827d-98ac063bc994 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:07.734785 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8e3d23c3-cd42-4d3d-827d-98ac063bc994 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:07.742000 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e3d23c3-cd42-4d3d-827d-98ac063bc994 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:07.742395 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e3d23c3-cd42-4d3d-827d-98ac063bc994 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:07.743282 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e3d23c3-cd42-4d3d-827d-98ac063bc994 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:07.744013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e3d23c3-cd42-4d3d-827d-98ac063bc994 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:07.891429 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8e3d23c3-cd42-4d3d-827d-98ac063bc994 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:07.903125 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8e3d23c3-cd42-4d3d-827d-98ac063bc994 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1708 microversion: 2.1 time: 0.173698 Jun 08 13:49:07.903781 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 148/296] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:07 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1708 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:08.340109 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6bbf5deb-3c05-41a0-8367-cae0a70b46f5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:08.340726 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6bbf5deb-3c05-41a0-8367-cae0a70b46f5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:08.347074 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6bbf5deb-3c05-41a0-8367-cae0a70b46f5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:08.347582 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6bbf5deb-3c05-41a0-8367-cae0a70b46f5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:08.348430 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6bbf5deb-3c05-41a0-8367-cae0a70b46f5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:08.348870 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6bbf5deb-3c05-41a0-8367-cae0a70b46f5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:08.482883 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6bbf5deb-3c05-41a0-8367-cae0a70b46f5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:08.491157 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6bbf5deb-3c05-41a0-8367-cae0a70b46f5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.154769 Jun 08 13:49:08.491730 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 149/297] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:08 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:08.521379 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:08.522578 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:08.528920 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:08.529371 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:08.530133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:08.530564 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:08.673665 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:08.681955 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:08.683480 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:08.684686 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0bb45ace-e559-4cda-abcc-a2bb2600dd8e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1741 microversion: 2.20 time: 0.167627 Jun 08 13:49:08.685905 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 149/298] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:08 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:08.921157 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-32e4efd0-1afe-4e52-903f-8b4c8bf47242 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:08.921776 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-32e4efd0-1afe-4e52-903f-8b4c8bf47242 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:08.928754 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-32e4efd0-1afe-4e52-903f-8b4c8bf47242 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:08.929210 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-32e4efd0-1afe-4e52-903f-8b4c8bf47242 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:08.930022 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-32e4efd0-1afe-4e52-903f-8b4c8bf47242 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:08.930463 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-32e4efd0-1afe-4e52-903f-8b4c8bf47242 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:09.063832 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-32e4efd0-1afe-4e52-903f-8b4c8bf47242 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:09.072596 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-32e4efd0-1afe-4e52-903f-8b4c8bf47242 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1708 microversion: 2.1 time: 0.155364 Jun 08 13:49:09.073249 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 150/299] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:08 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:09.508176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-45b9a12a-7494-4f57-b625-b7c97116ed3b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:09.508787 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-45b9a12a-7494-4f57-b625-b7c97116ed3b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:09.515023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45b9a12a-7494-4f57-b625-b7c97116ed3b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:09.515558 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45b9a12a-7494-4f57-b625-b7c97116ed3b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:09.516346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45b9a12a-7494-4f57-b625-b7c97116ed3b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:09.516890 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45b9a12a-7494-4f57-b625-b7c97116ed3b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:09.655181 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-45b9a12a-7494-4f57-b625-b7c97116ed3b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:09.662640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-45b9a12a-7494-4f57-b625-b7c97116ed3b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.158409 Jun 08 13:49:09.663196 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 150/300] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:09 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:09.702556 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:09.703162 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:09.706161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=72 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:09.710806 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:09.711251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:09.712002 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:09.712459 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:09.842117 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:09.850315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:09.851825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:09.853005 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9403ed5d-a336-4d0c-b85d-9cc83f8b1b62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1741 microversion: 2.20 time: 0.154314 Jun 08 13:49:09.853644 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 151/301] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:09 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:10.090754 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e92d0f33-a7fe-4d06-8537-95d4fd96f247 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:10.091439 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e92d0f33-a7fe-4d06-8537-95d4fd96f247 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:10.098035 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e92d0f33-a7fe-4d06-8537-95d4fd96f247 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:10.098484 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e92d0f33-a7fe-4d06-8537-95d4fd96f247 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:10.099423 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e92d0f33-a7fe-4d06-8537-95d4fd96f247 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:10.099860 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e92d0f33-a7fe-4d06-8537-95d4fd96f247 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:10.227018 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e92d0f33-a7fe-4d06-8537-95d4fd96f247 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:10.234777 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e92d0f33-a7fe-4d06-8537-95d4fd96f247 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1708 microversion: 2.1 time: 0.147998 Jun 08 13:49:10.235331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 151/302] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:10 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:10.680718 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3fec8a04-2a3c-4d8c-a134-3573253f3dfd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:10.681678 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3fec8a04-2a3c-4d8c-a134-3573253f3dfd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:10.687577 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3fec8a04-2a3c-4d8c-a134-3573253f3dfd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:10.688023 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3fec8a04-2a3c-4d8c-a134-3573253f3dfd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:10.688798 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3fec8a04-2a3c-4d8c-a134-3573253f3dfd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:10.689298 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3fec8a04-2a3c-4d8c-a134-3573253f3dfd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:10.820675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3fec8a04-2a3c-4d8c-a134-3573253f3dfd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:10.827860 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3fec8a04-2a3c-4d8c-a134-3573253f3dfd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.151007 Jun 08 13:49:10.828450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 152/303] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:10 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:10.870441 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:10.871176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:10.877846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:10.878292 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:10.879051 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:10.879574 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:11.023758 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:11.031564 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:11.033776 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:11.034996 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f18109b6-7a04-4c38-ab4d-14d0779ea0c5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1741 microversion: 2.20 time: 0.168324 Jun 08 13:49:11.035567 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 152/304] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:10 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:11.252976 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-107e5a71-b6aa-4d88-a6cd-8c7f72f4e26b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:11.253525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-107e5a71-b6aa-4d88-a6cd-8c7f72f4e26b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:11.259561 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-107e5a71-b6aa-4d88-a6cd-8c7f72f4e26b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:11.260009 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-107e5a71-b6aa-4d88-a6cd-8c7f72f4e26b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:11.260808 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-107e5a71-b6aa-4d88-a6cd-8c7f72f4e26b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:11.261252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-107e5a71-b6aa-4d88-a6cd-8c7f72f4e26b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:11.389690 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-107e5a71-b6aa-4d88-a6cd-8c7f72f4e26b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:11.398306 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-107e5a71-b6aa-4d88-a6cd-8c7f72f4e26b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1708 microversion: 2.1 time: 0.149874 Jun 08 13:49:11.398870 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 153/305] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:11 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:49:11.844804 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f380b4b3-4885-42ff-bdc6-8084b89c2c5a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:11.845946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f380b4b3-4885-42ff-bdc6-8084b89c2c5a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:11.852483 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f380b4b3-4885-42ff-bdc6-8084b89c2c5a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:11.852937 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f380b4b3-4885-42ff-bdc6-8084b89c2c5a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:11.853695 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f380b4b3-4885-42ff-bdc6-8084b89c2c5a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:11.854135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f380b4b3-4885-42ff-bdc6-8084b89c2c5a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:11.984085 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f380b4b3-4885-42ff-bdc6-8084b89c2c5a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:11.991908 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f380b4b3-4885-42ff-bdc6-8084b89c2c5a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.150831 Jun 08 13:49:11.992498 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 153/306] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:11 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:12.054061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:12.054640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:12.061091 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:12.061542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:12.062340 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:12.062777 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:12.188197 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:12.196077 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:12.197579 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:12.198731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-21d66039-a37d-4a30-ac83-c984051ff24e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1741 microversion: 2.20 time: 0.148676 Jun 08 13:49:12.199291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 154/307] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:12 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:12.416751 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-68c88a4b-8e79-4a5d-9873-7f613a951111 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:12.417365 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-68c88a4b-8e79-4a5d-9873-7f613a951111 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:12.423395 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-68c88a4b-8e79-4a5d-9873-7f613a951111 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:12.423846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-68c88a4b-8e79-4a5d-9873-7f613a951111 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:12.424639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-68c88a4b-8e79-4a5d-9873-7f613a951111 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:12.425076 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-68c88a4b-8e79-4a5d-9873-7f613a951111 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:12.556488 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-68c88a4b-8e79-4a5d-9873-7f613a951111 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:12.564667 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-68c88a4b-8e79-4a5d-9873-7f613a951111 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1708 microversion: 2.1 time: 0.151413 Jun 08 13:49:12.565294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 154/308] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:12 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:13.008565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f348982a-8967-4712-b1f7-8279355f3799 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:13.009174 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f348982a-8967-4712-b1f7-8279355f3799 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:13.015486 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f348982a-8967-4712-b1f7-8279355f3799 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:13.016046 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f348982a-8967-4712-b1f7-8279355f3799 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:13.016844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f348982a-8967-4712-b1f7-8279355f3799 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:13.017288 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f348982a-8967-4712-b1f7-8279355f3799 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:13.165363 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-0895de07-3956-4bd3-a650-ee026a0dada6 req-eeec2354-1ce1-4c60-b212-773972fc26f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777c65ea-2412-4080-9c2c-ee5201184c1e", "name": "network-vif-plugged", "status": "completed", "tag": "d1b9ce5f-7ee5-4967-93f0-2a76e3005b21"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:13.177861 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:13.178816 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f348982a-8967-4712-b1f7-8279355f3799 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:13.180597 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-0895de07-3956-4bd3-a650-ee026a0dada6 req-eeec2354-1ce1-4c60-b212-773972fc26f9 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:13.186609 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f348982a-8967-4712-b1f7-8279355f3799 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.181835 Jun 08 13:49:13.187179 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 155/309] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:13 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:13.189339 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-0895de07-3956-4bd3-a650-ee026a0dada6 req-eeec2354-1ce1-4c60-b212-773972fc26f9 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:13.203302 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-0895de07-3956-4bd3-a650-ee026a0dada6 req-eeec2354-1ce1-4c60-b212-773972fc26f9 service nova] Creating event network-vif-plugged:d1b9ce5f-7ee5-4967-93f0-2a76e3005b21 for instance 777c65ea-2412-4080-9c2c-ee5201184c1e on hv-cinder-81914 Jun 08 13:49:13.208867 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-0895de07-3956-4bd3-a650-ee026a0dada6 req-eeec2354-1ce1-4c60-b212-773972fc26f9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048522 Jun 08 13:49:13.209444 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 155/310] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:49:13.217541 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:13.219858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:13.225200 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:13.225660 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:13.226470 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:13.226953 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:13.385175 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:13.400783 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:13.402349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:13.412278 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0da5ae8f-8a57-46a2-a58b-f68347970acf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1741 microversion: 2.20 time: 0.190177 Jun 08 13:49:13.413282 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 156/311] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:13 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:13.583291 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0284fd77-f047-40ea-901e-4d223a186019 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:13.586450 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0284fd77-f047-40ea-901e-4d223a186019 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:13.591245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0284fd77-f047-40ea-901e-4d223a186019 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:13.591918 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0284fd77-f047-40ea-901e-4d223a186019 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:13.592957 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0284fd77-f047-40ea-901e-4d223a186019 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:13.593560 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0284fd77-f047-40ea-901e-4d223a186019 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:13.747488 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0284fd77-f047-40ea-901e-4d223a186019 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:13.764310 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0284fd77-f047-40ea-901e-4d223a186019 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1712 microversion: 2.1 time: 0.184297 Jun 08 13:49:13.764310 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 156/312] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:13 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1712 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:14.203487 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0edbb816-079a-41a7-b3ca-2a6d44b079f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:14.204269 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0edbb816-079a-41a7-b3ca-2a6d44b079f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:14.215371 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0edbb816-079a-41a7-b3ca-2a6d44b079f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:14.215850 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0edbb816-079a-41a7-b3ca-2a6d44b079f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:14.217032 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0edbb816-079a-41a7-b3ca-2a6d44b079f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:14.217522 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0edbb816-079a-41a7-b3ca-2a6d44b079f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:14.387828 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0edbb816-079a-41a7-b3ca-2a6d44b079f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:14.397726 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0edbb816-079a-41a7-b3ca-2a6d44b079f0 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.198356 Jun 08 13:49:14.398399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 157/313] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:14 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:14.431270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:14.431887 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:14.438637 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:14.439699 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:14.440652 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:14.441133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:14.605905 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:14.614504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:14.616014 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:14.617184 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5679d711-1292-4082-81b2-a38e17912089 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.190256 Jun 08 13:49:14.617738 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 157/314] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:14 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:15.230684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-6c6e045b-29fe-48a3-b18e-5b214d8f1498 req-3a5f435e-e73e-4c81-a5dc-fbcbd2c3da24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac779098-8aa5-40b8-ae7d-dc4e463f015b", "name": "network-vif-plugged", "status": "completed", "tag": "a0a7ddb0-7def-4156-9a5b-f3b477a1c311"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:15.245907 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-6c6e045b-29fe-48a3-b18e-5b214d8f1498 req-3a5f435e-e73e-4c81-a5dc-fbcbd2c3da24 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:15.246359 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-6c6e045b-29fe-48a3-b18e-5b214d8f1498 req-3a5f435e-e73e-4c81-a5dc-fbcbd2c3da24 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:15.260023 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-6c6e045b-29fe-48a3-b18e-5b214d8f1498 req-3a5f435e-e73e-4c81-a5dc-fbcbd2c3da24 service nova] Creating event network-vif-plugged:a0a7ddb0-7def-4156-9a5b-f3b477a1c311 for instance ac779098-8aa5-40b8-ae7d-dc4e463f015b on hv-cinder-81914 Jun 08 13:49:15.272194 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-6c6e045b-29fe-48a3-b18e-5b214d8f1498 req-3a5f435e-e73e-4c81-a5dc-fbcbd2c3da24 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045608 Jun 08 13:49:15.273215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 158/315] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:49:15.415130 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9082b504-14f7-4c70-9ddc-1f891e1cde48 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:15.418591 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-9082b504-14f7-4c70-9ddc-1f891e1cde48 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:15.422432 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9082b504-14f7-4c70-9ddc-1f891e1cde48 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:15.422894 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9082b504-14f7-4c70-9ddc-1f891e1cde48 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:15.424366 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9082b504-14f7-4c70-9ddc-1f891e1cde48 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:15.425053 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9082b504-14f7-4c70-9ddc-1f891e1cde48 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:15.581378 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-9082b504-14f7-4c70-9ddc-1f891e1cde48 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:15.590222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9082b504-14f7-4c70-9ddc-1f891e1cde48 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1370 microversion: 2.1 time: 0.179084 Jun 08 13:49:15.591026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 158/316] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:15 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:15.642340 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:15.645042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:15.654343 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:15.654803 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:15.655691 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:15.658809 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:15.862456 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:15.871480 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:15.873656 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:15.876090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0261e0d7-abb4-42ee-9b14-eb571d9a56be tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.237951 Jun 08 13:49:15.876090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 159/317] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:15 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:16.612884 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-398a3263-522d-44bb-8eb6-17840b17a4dd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:16.614114 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-398a3263-522d-44bb-8eb6-17840b17a4dd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:16.628951 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-398a3263-522d-44bb-8eb6-17840b17a4dd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:16.630925 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-398a3263-522d-44bb-8eb6-17840b17a4dd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:16.633269 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-398a3263-522d-44bb-8eb6-17840b17a4dd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:16.634370 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-398a3263-522d-44bb-8eb6-17840b17a4dd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:16.857254 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-398a3263-522d-44bb-8eb6-17840b17a4dd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:16.862657 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=100 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:16.869141 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-398a3263-522d-44bb-8eb6-17840b17a4dd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1564 microversion: 2.1 time: 0.264670 Jun 08 13:49:16.870230 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 159/318] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:16 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1564 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:16.890289 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-945616b7-b700-4ef9-928b-eafeb458f0e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:16.895777 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-945616b7-b700-4ef9-928b-eafeb458f0e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:16.901881 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:16.902885 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:16.910415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-945616b7-b700-4ef9-928b-eafeb458f0e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:16.912942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-945616b7-b700-4ef9-928b-eafeb458f0e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:16.913944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-945616b7-b700-4ef9-928b-eafeb458f0e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:16.915119 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-945616b7-b700-4ef9-928b-eafeb458f0e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:16.921069 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:16.921781 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:16.922726 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:16.923668 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:17.078187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-945616b7-b700-4ef9-928b-eafeb458f0e4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194059 Jun 08 13:49:17.079114 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 160/319] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 8 13:49:16 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:49:17.290495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:17.308662 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:17.311958 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:17.313638 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7ca636ab-6238-4280-ab74-32bbb7088a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.421482 Jun 08 13:49:17.326865 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 160/320] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:16 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:17.672540 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2b8f12f7-1f11-43a6-9fb9-b2e95ca47f4b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:17.673893 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2b8f12f7-1f11-43a6-9fb9-b2e95ca47f4b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:17.694101 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b8f12f7-1f11-43a6-9fb9-b2e95ca47f4b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:17.694101 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b8f12f7-1f11-43a6-9fb9-b2e95ca47f4b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:17.694101 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b8f12f7-1f11-43a6-9fb9-b2e95ca47f4b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:17.694101 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b8f12f7-1f11-43a6-9fb9-b2e95ca47f4b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:17.847562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:17.931906 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-2b8f12f7-1f11-43a6-9fb9-b2e95ca47f4b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lazy-loading 'services' on Instance uuid 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:49:18.314813 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2b8f12f7-1f11-43a6-9fb9-b2e95ca47f4b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4/os-volume_attachments/75884dc5-44a2-4fa9-a185-25926645918e" status: 202 len: 0 microversion: 2.1 time: 0.646438 Jun 08 13:49:18.319529 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 161/321] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:49:17 2022] DELETE /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4/os-volume_attachments/75884dc5-44a2-4fa9-a185-25926645918e => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:49:18.334948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:18.335666 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:18.357002 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:18.364694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:18.364694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:18.364694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:18.785626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:18.793631 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:18.795800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:18.797205 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8f910aa7-eb85-4dff-8f91-306a6a012cd8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.466572 Jun 08 13:49:18.797765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 161/322] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:18 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:19.298556 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-41ec6b54-afad-4971-943f-67de4fcdda6d req-16340a5f-f4e8-496d-b806-37d04368d7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777c65ea-2412-4080-9c2c-ee5201184c1e", "tag": "d1b9ce5f-7ee5-4967-93f0-2a76e3005b21"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:19.321112 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-41ec6b54-afad-4971-943f-67de4fcdda6d req-16340a5f-f4e8-496d-b806-37d04368d7bc service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:19.321112 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-41ec6b54-afad-4971-943f-67de4fcdda6d req-16340a5f-f4e8-496d-b806-37d04368d7bc service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:19.337155 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-41ec6b54-afad-4971-943f-67de4fcdda6d req-16340a5f-f4e8-496d-b806-37d04368d7bc service nova] Creating event network-changed:d1b9ce5f-7ee5-4967-93f0-2a76e3005b21 for instance 777c65ea-2412-4080-9c2c-ee5201184c1e on hv-cinder-81914 Jun 08 13:49:19.344683 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-41ec6b54-afad-4971-943f-67de4fcdda6d req-16340a5f-f4e8-496d-b806-37d04368d7bc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064770 Jun 08 13:49:19.350881 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 162/323] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:49:19.817455 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:19.818111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:19.853146 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:19.853609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:19.854432 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:19.854859 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:20.243064 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:20.259978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:20.267873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:20.269820 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-dda98e46-9c99-402e-a2c6-9fcb009a5e0c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.457732 Jun 08 13:49:20.271335 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 162/324] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:19 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:20.586300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0e81f390-1a66-4ad6-9930-aba409ca6150 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:20.586892 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0e81f390-1a66-4ad6-9930-aba409ca6150 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:20.607061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0e81f390-1a66-4ad6-9930-aba409ca6150 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:20.607061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0e81f390-1a66-4ad6-9930-aba409ca6150 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:20.607061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0e81f390-1a66-4ad6-9930-aba409ca6150 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:20.607061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0e81f390-1a66-4ad6-9930-aba409ca6150 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:20.653721 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0e81f390-1a66-4ad6-9930-aba409ca6150 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:49:21.009386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0e81f390-1a66-4ad6-9930-aba409ca6150 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 204 len: 0 microversion: 2.1 time: 0.428937 Jun 08 13:49:21.011959 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 163/325] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:49:20 2022] DELETE /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:49:21.021037 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-116f3248-ff12-4731-9449-5fa2255e6e87 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:21.022362 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-116f3248-ff12-4731-9449-5fa2255e6e87 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:21.034021 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-116f3248-ff12-4731-9449-5fa2255e6e87 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:21.037153 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-116f3248-ff12-4731-9449-5fa2255e6e87 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:21.037970 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-116f3248-ff12-4731-9449-5fa2255e6e87 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:21.038419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-116f3248-ff12-4731-9449-5fa2255e6e87 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:21.226632 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-116f3248-ff12-4731-9449-5fa2255e6e87 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:21.238288 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-116f3248-ff12-4731-9449-5fa2255e6e87 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1513 microversion: 2.1 time: 0.221911 Jun 08 13:49:21.249255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 163/326] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:21 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:21.295365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:21.296521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:21.303396 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:21.304113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:21.305070 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:21.305675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:21.499710 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:21.510139 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:21.511879 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:21.513551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4e507cfb-d0be-4a15-b3d1-9a1ef2ffcf47 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.223216 Jun 08 13:49:21.514283 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 164/327] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:21 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:22.260570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-71bea654-22c0-4718-bfbf-c376b263217b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:22.261941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-71bea654-22c0-4718-bfbf-c376b263217b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:22.270348 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-71bea654-22c0-4718-bfbf-c376b263217b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:22.271137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-71bea654-22c0-4718-bfbf-c376b263217b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:22.272376 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-71bea654-22c0-4718-bfbf-c376b263217b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:22.272979 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-71bea654-22c0-4718-bfbf-c376b263217b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:22.432344 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-71bea654-22c0-4718-bfbf-c376b263217b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:22.440458 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-71bea654-22c0-4718-bfbf-c376b263217b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1513 microversion: 2.1 time: 0.188996 Jun 08 13:49:22.441030 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 164/328] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:22 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:22.533436 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:22.534077 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:22.540807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:22.541253 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:22.542049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:22.542483 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:22.696839 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:22.708201 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:22.709849 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:22.711012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a25676fe-daba-483e-8225-027b9944a609 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.181551 Jun 08 13:49:22.711878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 165/329] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:22 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:23.459413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0c3f6b6c-58cf-4c72-87e1-10a313724d7a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:23.460026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0c3f6b6c-58cf-4c72-87e1-10a313724d7a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:23.499855 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0c3f6b6c-58cf-4c72-87e1-10a313724d7a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:23.500627 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0c3f6b6c-58cf-4c72-87e1-10a313724d7a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:23.501825 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0c3f6b6c-58cf-4c72-87e1-10a313724d7a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:23.502432 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0c3f6b6c-58cf-4c72-87e1-10a313724d7a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:23.730309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:23.730929 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:23.738465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0c3f6b6c-58cf-4c72-87e1-10a313724d7a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:23.743382 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:23.743802 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:23.744625 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:23.745063 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:23.747393 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0c3f6b6c-58cf-4c72-87e1-10a313724d7a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1513 microversion: 2.1 time: 0.293482 Jun 08 13:49:23.753168 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 165/330] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:23 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:23.856822 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-7406a9f3-4e02-461f-9a9f-e4d1974d8c1a req-6a40e365-d2b6-4852-abda-db830bbe6b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2101b3-fbbb-4d6e-a75e-05341cdd88f4", "name": "network-vif-deleted", "tag": "05a82aa7-0a4e-4e39-9039-9e40ee1827d5"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:23.876805 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-7406a9f3-4e02-461f-9a9f-e4d1974d8c1a req-6a40e365-d2b6-4852-abda-db830bbe6b48 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:23.877586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-7406a9f3-4e02-461f-9a9f-e4d1974d8c1a req-6a40e365-d2b6-4852-abda-db830bbe6b48 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:23.891005 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-7406a9f3-4e02-461f-9a9f-e4d1974d8c1a req-6a40e365-d2b6-4852-abda-db830bbe6b48 service nova] Creating event network-vif-deleted:05a82aa7-0a4e-4e39-9039-9e40ee1827d5 for instance 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 on hv-cinder-81914 Jun 08 13:49:23.910374 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-7406a9f3-4e02-461f-9a9f-e4d1974d8c1a req-6a40e365-d2b6-4852-abda-db830bbe6b48 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057342 Jun 08 13:49:23.912880 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 166/331] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:49:23.958367 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:23.973118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:23.975883 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:23.977464 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-56a32475-e1a1-465e-9129-9d10259d04c2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.250890 Jun 08 13:49:23.993792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 166/332] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:23 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:24.773398 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:24.774816 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:24.788222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:24.788703 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:24.789509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:24.789944 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:24.857468 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:24.858243 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:24.858860 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lazy-loading 'fault' on Instance uuid 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:49:24.927080 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:24.937282 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-971ba626-80fe-4f6a-8515-366d86d54817 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 200 len: 1308 microversion: 2.1 time: 0.170289 Jun 08 13:49:24.937282 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 167/333] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:24 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:25.002519 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:25.003277 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:25.010470 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:25.011302 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:25.012175 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:25.012606 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:25.202525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:25.218212 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:25.218212 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:25.218212 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f7dafb3b-db88-4601-90aa-2137a1e75c84 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.218842 Jun 08 13:49:25.218639 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 167/334] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:24 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:25.955305 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:25.956116 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:25.963343 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:25.963847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:25.965039 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:25.965854 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:25.981331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] HTTP exception thrown: Instance 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 could not be found. Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Request method failure captured: Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 HTTP/1.1 Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKiPz_c6p9HR1UbnMcRnBEtn4Jk1QxZ3VdY0ExUvVTuXYc8wXlWi_0mgCTNApuW8_2TCl7PBnpqnXwjBgXrxzmdC_Y7_WPxeXL4wrzpISEJmc2iQobEspNzIwFcGI2QQNTj9RhYBg9-JkV8LUzJrlb86KhEe93kqNi1XQ18L7DV1vQY Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 1b38f30ffdc74b66aa2a5ed7d7eb1e0d Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2052363107 Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:49:25.983182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1b38f30ffdc74b66aa2a5ed7d7eb1e0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1b38f30ffdc74b66aa2a5ed7d7eb1e0d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1b38f30ffdc74b66aa2a5ed7d7eb1e0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1b38f30ffdc74b66aa2a5ed7d7eb1e0d"}]}] Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-VolumesSnapshotTestJSON-2052363107 Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 1b38f30ffdc74b66aa2a5ed7d7eb1e0d Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2052363107 Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-VolumesSnapshotTestJSON-2052363107-project Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 28d78d4ead234cc68e377c8b5b6e4d5a Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-VolumesSnapshotTestJSON-2052363107-project Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 could not be found. Jun 08 13:49:25.984752 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '0f2101b3-fbbb-4d6e-a75e-05341cdd88f4'} Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 could not be found. Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:49:25.989332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 could not be found. Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 could not be found. Jun 08 13:49:25.990575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:49:25.991735 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Returning 404 to user: Instance 0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:49:25.991735 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-cf868e80-7617-4e7a-a288-7b2e401e5b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4" status: 404 len: 111 microversion: 2.1 time: 0.034113 Jun 08 13:49:25.991735 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 168/335] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:25 2022] GET /compute/v2.1/servers/0f2101b3-fbbb-4d6e-a75e-05341cdd88f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:49:26.237208 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:26.237986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:26.244603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:26.245066 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:26.245837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:26.246278 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:26.398064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:26.406015 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:26.407569 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:26.408757 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b9c29863-40a8-406f-8a05-c53db7cf1e28 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.176027 Jun 08 13:49:26.409320 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 168/336] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:26 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:27.427849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:27.428509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:27.435314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:27.435767 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:27.436562 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:27.437002 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:27.589378 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:27.603459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:27.603459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:27.603459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-72286deb-fe4d-4f12-94b5-17c7121f3f5f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.179074 Jun 08 13:49:27.604030 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 169/337] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:27 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:28.622169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:28.622841 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:28.630118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:28.630567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:28.631330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:28.631880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:28.765273 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:28.773287 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:28.774801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:28.775970 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6692d1e5-a233-4018-b5fe-f174a4932963 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.157676 Jun 08 13:49:28.776601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 169/338] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:28 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:29.794335 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:29.794948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:29.801674 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:29.802124 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:29.802890 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:29.803326 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:29.928924 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:29.936740 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:29.938765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:29.939928 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-332c2916-e4d4-4385-8037-007d084a03ee tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1736 microversion: 2.20 time: 0.149510 Jun 08 13:49:29.940527 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 170/339] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:29 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:30.959226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:30.959839 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:30.966387 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:30.966842 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:30.967614 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:30.968078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:31.115805 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:31.128026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:31.128026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:31.128026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7740e003-285c-4f0b-a24c-39b74b12957f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1718 microversion: 2.20 time: 0.173450 Jun 08 13:49:31.128881 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 170/340] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:30 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:32.147101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:32.147709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:32.154194 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:32.154646 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:32.155411 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:32.155847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:32.299703 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:32.308712 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:32.310235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:32.311417 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2d937979-a821-4d5e-a0f0-4a897e2caf4e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1718 microversion: 2.20 time: 0.168200 Jun 08 13:49:32.311977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 171/341] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:32 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:33.059485 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-e741767c-bd5c-48a9-a3ce-5847f766372c req-73ab2c84-c8c4-4cfd-b74c-cd325cc12c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac779098-8aa5-40b8-ae7d-dc4e463f015b", "name": "network-vif-unplugged", "status": "completed", "tag": "a0a7ddb0-7def-4156-9a5b-f3b477a1c311"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:33.068450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e741767c-bd5c-48a9-a3ce-5847f766372c req-73ab2c84-c8c4-4cfd-b74c-cd325cc12c08 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:33.068897 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e741767c-bd5c-48a9-a3ce-5847f766372c req-73ab2c84-c8c4-4cfd-b74c-cd325cc12c08 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:33.079958 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-e741767c-bd5c-48a9-a3ce-5847f766372c req-73ab2c84-c8c4-4cfd-b74c-cd325cc12c08 service nova] Creating event network-vif-unplugged:a0a7ddb0-7def-4156-9a5b-f3b477a1c311 for instance ac779098-8aa5-40b8-ae7d-dc4e463f015b on hv-cinder-81914 Jun 08 13:49:33.085128 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-e741767c-bd5c-48a9-a3ce-5847f766372c req-73ab2c84-c8c4-4cfd-b74c-cd325cc12c08 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029628 Jun 08 13:49:33.086156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 171/342] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:49:33.330740 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:33.331413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:33.338430 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:33.338863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:33.339707 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:33.340277 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:33.490329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:33.499856 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:33.502604 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:33.503986 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-14699ac5-6ecb-40f6-834b-604c01b30eef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1718 microversion: 2.20 time: 0.177955 Jun 08 13:49:33.504626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 172/343] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:33 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1718 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:34.524401 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:34.525099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:34.532191 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:34.532652 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:34.533423 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:34.533866 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:34.667561 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:34.675825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:34.677383 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:34.678543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1932c1c2-6fcd-4857-b222-95f435511f5b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1718 microversion: 2.20 time: 0.158388 Jun 08 13:49:34.679111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 172/344] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:34 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:35.697135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:35.697706 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:35.705307 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:35.705753 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:35.706510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:35.706940 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:35.838822 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:35.848157 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:35.849673 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:35.850837 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-04aa5c82-438f-41c6-a858-63e20b17e266 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1718 microversion: 2.20 time: 0.157780 Jun 08 13:49:35.851514 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 173/345] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:35 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:36.870502 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:36.871209 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:36.878705 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:36.879220 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:36.880086 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:36.880579 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:37.019209 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:37.027301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:37.028914 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:37.030063 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b8e050ea-95f8-4d75-8f42-2082867b901f tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1721 microversion: 2.20 time: 0.164285 Jun 08 13:49:37.030625 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 173/346] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:36 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:37.054733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-84df465d-f317-4614-847b-a8d6155dee77 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69e6bd74-3ce6-4e16-ac4c-aa8f491750a8"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:37.055896 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-84df465d-f317-4614-847b-a8d6155dee77 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:37.064771 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84df465d-f317-4614-847b-a8d6155dee77 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:37.065459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84df465d-f317-4614-847b-a8d6155dee77 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:37.066530 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84df465d-f317-4614-847b-a8d6155dee77 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:37.067180 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84df465d-f317-4614-847b-a8d6155dee77 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:37.093311 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1550541142", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "networks": [{"uuid": "f78d1fdb-0f8f-4ba8-9c46-69c0b872862d"}]}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:37.158107 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] validate_networks() for [('f78d1fdb-0f8f-4ba8-9c46-69c0b872862d', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:49:37.534751 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:49:37.535202 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:49:37.535675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:49:37.536100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:49:37.536509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:49:37.546051 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:37.546503 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:37.548238 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:37.548792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:37.566063 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Getting quotas for project 1b38f30ffdc74b66aa2a5ed7d7eb1e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:49:37.571028 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Getting quotas for user 28d78d4ead234cc68e377c8b5b6e4d5a and project 1b38f30ffdc74b66aa2a5ed7d7eb1e0d. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:49:37.583247 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:49:37.585566 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:49:37.761732 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-951f7ee6-7c9c-46c4-aafb-35092c315236 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673467 Jun 08 13:49:37.767704 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 174/347] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 08 13:49:37.773901 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-540aeb02-0435-4b4c-bcc8-c2c4eb2205be tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:37.774834 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-540aeb02-0435-4b4c-bcc8-c2c4eb2205be tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:37.831587 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-540aeb02-0435-4b4c-bcc8-c2c4eb2205be tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:37.838925 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-540aeb02-0435-4b4c-bcc8-c2c4eb2205be tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1219 microversion: 2.1 time: 0.068881 Jun 08 13:49:37.839684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 175/348] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:37 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:38.232244 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:38.316617 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-84df465d-f317-4614-847b-a8d6155dee77 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.265785 Jun 08 13:49:38.317250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 174/349] 10.222.0.55 () {62 vars in 1363 bytes} [Wed Jun 8 13:49:37 2022] POST /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments => generated 188 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 13:49:38.454480 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fc54066f-2f9e-4ec5-86a5-2376403725b7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:38.455231 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fc54066f-2f9e-4ec5-86a5-2376403725b7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:38.462117 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fc54066f-2f9e-4ec5-86a5-2376403725b7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:38.462725 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fc54066f-2f9e-4ec5-86a5-2376403725b7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:38.463678 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fc54066f-2f9e-4ec5-86a5-2376403725b7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:38.464196 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fc54066f-2f9e-4ec5-86a5-2376403725b7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:38.754553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fc54066f-2f9e-4ec5-86a5-2376403725b7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/action" status: 202 len: 0 microversion: 2.20 time: 0.305310 Jun 08 13:49:38.758520 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 176/350] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 8 13:49:38 2022] POST /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:49:38.763841 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:38.764756 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:38.773040 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:38.773490 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:38.774276 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:38.774716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:38.857701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2f539f4c-1bd5-433a-b814-b66b3ad758f8 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:38.858657 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2f539f4c-1bd5-433a-b814-b66b3ad758f8 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:38.866544 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f539f4c-1bd5-433a-b814-b66b3ad758f8 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:38.867492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f539f4c-1bd5-433a-b814-b66b3ad758f8 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:38.868592 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f539f4c-1bd5-433a-b814-b66b3ad758f8 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:38.869443 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f539f4c-1bd5-433a-b814-b66b3ad758f8 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:38.946184 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:38.948543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2f539f4c-1bd5-433a-b814-b66b3ad758f8 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:38.951229 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:38.955579 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:38.957130 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:38.958941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c8ff8554-8b73-4ac2-8a20-07bffd89f9ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1747 microversion: 2.20 time: 0.198611 Jun 08 13:49:38.959053 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2f539f4c-1bd5-433a-b814-b66b3ad758f8 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1223 microversion: 2.1 time: 0.104950 Jun 08 13:49:38.968189 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 177/351] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:38 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:49:38.970157 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 175/352] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:38 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1747 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:39.976423 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fd594575-e899-45b7-8495-ec6ad14f3870 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:39.977124 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fd594575-e899-45b7-8495-ec6ad14f3870 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:39.977669 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:39.978277 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:39.980822 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:39.986988 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:39.987586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:39.988382 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:39.988817 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:39.989242 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd594575-e899-45b7-8495-ec6ad14f3870 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:39.989700 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd594575-e899-45b7-8495-ec6ad14f3870 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:39.990486 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd594575-e899-45b7-8495-ec6ad14f3870 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:39.990931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd594575-e899-45b7-8495-ec6ad14f3870 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:40.091158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-fd594575-e899-45b7-8495-ec6ad14f3870 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:40.102914 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fd594575-e899-45b7-8495-ec6ad14f3870 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1271 microversion: 2.1 time: 0.130843 Jun 08 13:49:40.103503 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 178/353] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:39 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:40.166106 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:40.175417 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:40.176943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:40.178107 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0d0f1cac-872b-47cb-b0da-6f693577caba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1747 microversion: 2.20 time: 0.204280 Jun 08 13:49:40.178667 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 176/354] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:39 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1747 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:41.121142 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ee442257-4eb9-4ab8-8348-d5a3eb0a2ac5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:41.121959 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ee442257-4eb9-4ab8-8348-d5a3eb0a2ac5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:41.132908 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ee442257-4eb9-4ab8-8348-d5a3eb0a2ac5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:41.134048 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ee442257-4eb9-4ab8-8348-d5a3eb0a2ac5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:41.135875 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ee442257-4eb9-4ab8-8348-d5a3eb0a2ac5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:41.137395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ee442257-4eb9-4ab8-8348-d5a3eb0a2ac5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:41.199376 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:41.200272 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:41.208352 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:41.208801 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:41.209602 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:41.210745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:41.389027 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ee442257-4eb9-4ab8-8348-d5a3eb0a2ac5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:41.396736 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ee442257-4eb9-4ab8-8348-d5a3eb0a2ac5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.280055 Jun 08 13:49:41.397311 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 179/355] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:41 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:41.414443 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:41.423554 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:41.425089 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:41.426257 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c5f8c66b-c526-4d69-9d32-1837f1f20abb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1749 microversion: 2.20 time: 0.231516 Jun 08 13:49:41.426808 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 177/356] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:41 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1749 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:42.302797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-763e8fc5-65ae-48d9-87d4-f00e6721f530 req-42b4d4fa-cfb1-45fa-b3d1-27653e4b3ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5333f0-e2b2-4fae-9392-8dedd5bee5cb", "tag": "54564d2a-ca9f-4f1a-998d-b332f1702e71"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:42.314157 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-763e8fc5-65ae-48d9-87d4-f00e6721f530 req-42b4d4fa-cfb1-45fa-b3d1-27653e4b3ef5 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:42.314610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-763e8fc5-65ae-48d9-87d4-f00e6721f530 req-42b4d4fa-cfb1-45fa-b3d1-27653e4b3ef5 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:42.325955 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-763e8fc5-65ae-48d9-87d4-f00e6721f530 req-42b4d4fa-cfb1-45fa-b3d1-27653e4b3ef5 service nova] Creating event network-changed:54564d2a-ca9f-4f1a-998d-b332f1702e71 for instance 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb on hv-cinder-81914 Jun 08 13:49:42.333297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-763e8fc5-65ae-48d9-87d4-f00e6721f530 req-42b4d4fa-cfb1-45fa-b3d1-27653e4b3ef5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034283 Jun 08 13:49:42.333897 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 180/357] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:49:42.421570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0b1a5efe-119f-463d-be25-528c9e9e04c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:42.423775 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0b1a5efe-119f-463d-be25-528c9e9e04c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:42.431631 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0b1a5efe-119f-463d-be25-528c9e9e04c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:42.432395 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0b1a5efe-119f-463d-be25-528c9e9e04c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:42.433228 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0b1a5efe-119f-463d-be25-528c9e9e04c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:42.433854 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0b1a5efe-119f-463d-be25-528c9e9e04c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:42.455634 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:42.455634 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:42.456462 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:42.457082 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:42.457873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:42.458318 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:42.676316 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0b1a5efe-119f-463d-be25-528c9e9e04c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:42.678630 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:42.686049 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0b1a5efe-119f-463d-be25-528c9e9e04c9 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.271235 Jun 08 13:49:42.688101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 178/358] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:42 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:42.691379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:42.695542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:42.699795 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f1805954-de19-4f71-bb19-bbc954310ad4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1749 microversion: 2.20 time: 0.256001 Jun 08 13:49:42.711601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 181/359] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:42 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1749 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:43.710100 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4946b9ff-9f6b-4150-a750-7d72a2626ebb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:43.710727 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4946b9ff-9f6b-4150-a750-7d72a2626ebb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:43.719412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4946b9ff-9f6b-4150-a750-7d72a2626ebb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:43.719987 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4946b9ff-9f6b-4150-a750-7d72a2626ebb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:43.720798 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4946b9ff-9f6b-4150-a750-7d72a2626ebb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:43.721098 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:43.721819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4946b9ff-9f6b-4150-a750-7d72a2626ebb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:43.722662 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:43.730713 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:43.731706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:43.733129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:43.733975 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:43.952585 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4946b9ff-9f6b-4150-a750-7d72a2626ebb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:43.954931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:43.965042 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4946b9ff-9f6b-4150-a750-7d72a2626ebb tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.264759 Jun 08 13:49:43.965722 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:43.967366 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:43.969581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-df33c550-6b6b-4e9f-a19b-fdc9e59dae7e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.254575 Jun 08 13:49:43.971027 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 182/360] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:43 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:43.979824 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 179/361] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:43 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:44.991126 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:45.001547 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:45.001660 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8e208eb8-114e-4394-8aae-254db9aa0b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:45.001660 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8e208eb8-114e-4394-8aae-254db9aa0b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:45.008150 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=52 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:45.013301 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:45.014081 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:45.014790 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8e208eb8-114e-4394-8aae-254db9aa0b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:45.017756 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:45.018422 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8e208eb8-114e-4394-8aae-254db9aa0b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:45.018862 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:45.024130 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8e208eb8-114e-4394-8aae-254db9aa0b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:45.024130 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8e208eb8-114e-4394-8aae-254db9aa0b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:45.278609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:45.298139 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:45.302529 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:45.316273 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6cd877bd-5b4b-42f9-b31f-5782d8816adb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.318372 Jun 08 13:49:45.318984 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 180/362] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:44 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:45.337129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8e208eb8-114e-4394-8aae-254db9aa0b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:45.345291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8e208eb8-114e-4394-8aae-254db9aa0b0d tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.361763 Jun 08 13:49:45.346700 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 183/363] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:44 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:46.325557 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:46.327237 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:46.354928 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:46.355390 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:46.357943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:46.358463 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:46.368530 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e82ac8a4-117c-449e-9b35-de987f830d43 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:46.370382 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e82ac8a4-117c-449e-9b35-de987f830d43 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:46.379363 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e82ac8a4-117c-449e-9b35-de987f830d43 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:46.380293 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e82ac8a4-117c-449e-9b35-de987f830d43 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:46.381343 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e82ac8a4-117c-449e-9b35-de987f830d43 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:46.385928 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e82ac8a4-117c-449e-9b35-de987f830d43 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:46.747847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:46.773743 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e82ac8a4-117c-449e-9b35-de987f830d43 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:46.775203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:46.777399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:46.782261 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ef1c7f7c-3b8e-4265-9a73-5ff67978231b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.458765 Jun 08 13:49:46.783544 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 181/364] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:46 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:46.789958 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e82ac8a4-117c-449e-9b35-de987f830d43 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.430475 Jun 08 13:49:46.795755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 184/365] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:46 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:47.802877 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:47.804161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:47.815460 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-619e0f9b-3c59-43b6-80fe-32bc9235f368 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:47.816959 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-619e0f9b-3c59-43b6-80fe-32bc9235f368 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:47.819701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:47.825454 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:47.828501 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:47.829625 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:47.831873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:47.856433 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=8 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:47.858477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-619e0f9b-3c59-43b6-80fe-32bc9235f368 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:47.859799 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-619e0f9b-3c59-43b6-80fe-32bc9235f368 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:47.860662 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-619e0f9b-3c59-43b6-80fe-32bc9235f368 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:47.861106 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-619e0f9b-3c59-43b6-80fe-32bc9235f368 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:48.358810 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:48.375700 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:48.377632 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:48.381300 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d7a6d117-9659-4fd5-99b9-7f3b7b671f0b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.582456 Jun 08 13:49:48.387428 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 182/366] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:47 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:48.404260 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-3728476c-57e1-4a40-b367-c0be139be691 req-74318129-d106-4f0d-b1e1-b40affeae298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5333f0-e2b2-4fae-9392-8dedd5bee5cb", "name": "network-vif-plugged", "status": "completed", "tag": "54564d2a-ca9f-4f1a-998d-b332f1702e71"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:49:48.425046 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-3728476c-57e1-4a40-b367-c0be139be691 req-74318129-d106-4f0d-b1e1-b40affeae298 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:48.426180 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-3728476c-57e1-4a40-b367-c0be139be691 req-74318129-d106-4f0d-b1e1-b40affeae298 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:48.431143 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-619e0f9b-3c59-43b6-80fe-32bc9235f368 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:48.442063 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-619e0f9b-3c59-43b6-80fe-32bc9235f368 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.631287 Jun 08 13:49:48.443251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 185/367] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:47 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:48.452076 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-3728476c-57e1-4a40-b367-c0be139be691 req-74318129-d106-4f0d-b1e1-b40affeae298 service nova] Creating event network-vif-plugged:54564d2a-ca9f-4f1a-998d-b332f1702e71 for instance 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb on hv-cinder-81914 Jun 08 13:49:48.474306 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-3728476c-57e1-4a40-b367-c0be139be691 req-74318129-d106-4f0d-b1e1-b40affeae298 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081846 Jun 08 13:49:48.482625 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 183/368] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:49:49.410246 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:49.411801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:49.424980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:49.426403 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:49.428494 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:49.430006 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:49.463078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bd4a2ede-6f76-426b-8c48-17dbdb29fb2c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:49.463904 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bd4a2ede-6f76-426b-8c48-17dbdb29fb2c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:49.481470 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd4a2ede-6f76-426b-8c48-17dbdb29fb2c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:49.486548 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd4a2ede-6f76-426b-8c48-17dbdb29fb2c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:49.488490 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd4a2ede-6f76-426b-8c48-17dbdb29fb2c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:49.491312 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd4a2ede-6f76-426b-8c48-17dbdb29fb2c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:49.756508 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bd4a2ede-6f76-426b-8c48-17dbdb29fb2c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:49.765792 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bd4a2ede-6f76-426b-8c48-17dbdb29fb2c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.307469 Jun 08 13:49:49.777113 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 184/369] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:49 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:49:49.785147 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:49.809337 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:49.811320 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:49.813538 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ced9dc59-a47b-468a-a24c-903a6d20a560 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.410582 Jun 08 13:49:49.826866 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 186/370] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:49 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:50.783718 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7be7f8e3-691e-43ab-b123-61371dccdb5a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:50.784361 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7be7f8e3-691e-43ab-b123-61371dccdb5a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:50.790719 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7be7f8e3-691e-43ab-b123-61371dccdb5a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:50.791415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7be7f8e3-691e-43ab-b123-61371dccdb5a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:50.792485 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7be7f8e3-691e-43ab-b123-61371dccdb5a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:50.792915 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7be7f8e3-691e-43ab-b123-61371dccdb5a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:50.834753 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:50.835349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:50.854883 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:50.855645 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:50.857081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:50.857686 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:51.263247 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7be7f8e3-691e-43ab-b123-61371dccdb5a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:51.295709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7be7f8e3-691e-43ab-b123-61371dccdb5a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.503671 Jun 08 13:49:51.317889 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 185/371] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:50 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:51.331299 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:51.355475 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:51.362779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:51.366070 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4ed78242-5535-4e89-ac7d-8e576df100a0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.535723 Jun 08 13:49:51.367937 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 187/372] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:50 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:52.315830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d019fe84-20b9-4bdf-b6e5-21a16f7bfbd5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:52.316483 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d019fe84-20b9-4bdf-b6e5-21a16f7bfbd5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:52.323227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d019fe84-20b9-4bdf-b6e5-21a16f7bfbd5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:52.323687 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d019fe84-20b9-4bdf-b6e5-21a16f7bfbd5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:52.324609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d019fe84-20b9-4bdf-b6e5-21a16f7bfbd5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:52.325054 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d019fe84-20b9-4bdf-b6e5-21a16f7bfbd5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:52.387090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:52.387688 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:52.398033 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:52.398500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:52.399317 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:52.399741 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:52.543492 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d019fe84-20b9-4bdf-b6e5-21a16f7bfbd5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:52.553765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d019fe84-20b9-4bdf-b6e5-21a16f7bfbd5 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.242856 Jun 08 13:49:52.554493 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 186/373] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:52 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:52.590502 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:52.601398 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:52.603294 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:52.604712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-140feb63-851d-42d6-a1d1-df081cc0563c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.221765 Jun 08 13:49:52.605685 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 188/374] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:52 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:53.571021 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bf1c2350-29de-4d3b-aaf6-655270bed847 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:53.571628 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bf1c2350-29de-4d3b-aaf6-655270bed847 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:53.579232 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf1c2350-29de-4d3b-aaf6-655270bed847 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:53.579758 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf1c2350-29de-4d3b-aaf6-655270bed847 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:53.581116 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf1c2350-29de-4d3b-aaf6-655270bed847 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:53.581791 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf1c2350-29de-4d3b-aaf6-655270bed847 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:53.624530 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:53.625240 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:53.643431 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:53.644420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:53.645477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:53.646123 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:53.805904 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bf1c2350-29de-4d3b-aaf6-655270bed847 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:53.816809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bf1c2350-29de-4d3b-aaf6-655270bed847 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.249543 Jun 08 13:49:53.821416 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 187/375] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:53 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:53.920281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:53.933341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:53.935432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:53.942840 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-16883289-8d9b-4c10-b2a4-467054fb8a7c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.320488 Jun 08 13:49:53.943898 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 189/376] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:53 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:54.838406 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1abc2063-b8f0-428c-9aad-869cc6be9b51 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:54.839790 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1abc2063-b8f0-428c-9aad-869cc6be9b51 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:54.855067 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1abc2063-b8f0-428c-9aad-869cc6be9b51 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:54.857485 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1abc2063-b8f0-428c-9aad-869cc6be9b51 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:54.858573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1abc2063-b8f0-428c-9aad-869cc6be9b51 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:54.861764 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1abc2063-b8f0-428c-9aad-869cc6be9b51 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:54.963281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:54.968746 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:54.972168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:54.972828 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:54.973935 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:54.974541 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:55.215674 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1abc2063-b8f0-428c-9aad-869cc6be9b51 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:55.227079 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1abc2063-b8f0-428c-9aad-869cc6be9b51 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.393045 Jun 08 13:49:55.231310 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 188/377] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:54 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:55.279280 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:55.289365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:55.298987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:55.301053 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0bad3976-5ea1-4969-9666-e8a9cbc8ecf4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.342089 Jun 08 13:49:55.312962 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 190/378] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:54 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:56.071771 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-27b5cf73-9073-4cd8-bc0e-719af540dc24 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:56.077771 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-27b5cf73-9073-4cd8-bc0e-719af540dc24 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:56.117951 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-27b5cf73-9073-4cd8-bc0e-719af540dc24 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:56.118446 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-27b5cf73-9073-4cd8-bc0e-719af540dc24 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:56.119261 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-27b5cf73-9073-4cd8-bc0e-719af540dc24 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:56.119705 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-27b5cf73-9073-4cd8-bc0e-719af540dc24 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:56.248778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1950bee5-f1d4-461a-ba95-bc6bc2465fa6 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:56.250621 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1950bee5-f1d4-461a-ba95-bc6bc2465fa6 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:56.273952 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1950bee5-f1d4-461a-ba95-bc6bc2465fa6 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:56.273952 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1950bee5-f1d4-461a-ba95-bc6bc2465fa6 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:56.275330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1950bee5-f1d4-461a-ba95-bc6bc2465fa6 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:56.276234 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1950bee5-f1d4-461a-ba95-bc6bc2465fa6 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:56.369542 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-27b5cf73-9073-4cd8-bc0e-719af540dc24 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lazy-loading 'services' on Instance uuid 1db0ac6d-b933-4abd-96b8-c1af36e06791 {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:49:56.548231 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1950bee5-f1d4-461a-ba95-bc6bc2465fa6 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:56.557315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1950bee5-f1d4-461a-ba95-bc6bc2465fa6 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.312485 Jun 08 13:49:56.569330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 191/379] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:56 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:56.579315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:56.579315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:56.582777 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:56.583235 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:56.584014 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:56.584664 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:56.747043 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:56.760724 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:56.762953 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:56.768966 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-68bc9aca-beea-438f-85e8-73c180bb769a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.198318 Jun 08 13:49:56.770077 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 192/380] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:56 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:56.861994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-27b5cf73-9073-4cd8-bc0e-719af540dc24 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/os-volume_attachments/0f2cee6e-2a43-4622-ba09-20a179d65d38" status: 202 len: 0 microversion: 2.1 time: 0.800578 Jun 08 13:49:56.863361 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 189/381] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:49:56 2022] DELETE /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/os-volume_attachments/0f2cee6e-2a43-4622-ba09-20a179d65d38 => generated 0 bytes in 805 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:49:57.575133 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1f2be710-91f3-41f5-a71b-b8d2722d0618 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:57.575745 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1f2be710-91f3-41f5-a71b-b8d2722d0618 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:57.607004 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f2be710-91f3-41f5-a71b-b8d2722d0618 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:57.607476 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f2be710-91f3-41f5-a71b-b8d2722d0618 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:57.613253 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f2be710-91f3-41f5-a71b-b8d2722d0618 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:57.613766 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f2be710-91f3-41f5-a71b-b8d2722d0618 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:57.788915 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:57.794010 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:57.803968 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:57.804469 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:57.805266 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:57.805713 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:58.145638 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:58.152996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1f2be710-91f3-41f5-a71b-b8d2722d0618 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:58.156426 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:58.158309 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:58.159812 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2c1609f8-b811-489e-ad89-e6f169af0930 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.376442 Jun 08 13:49:58.170672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 190/382] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:57 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:49:58.175125 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1f2be710-91f3-41f5-a71b-b8d2722d0618 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.602972 Jun 08 13:49:58.175125 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 193/383] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:57 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:49:59.179000 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:59.179570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:59.188109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:59.188586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:59.189403 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:59.189848 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:59.191399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f8d58661-b479-4752-b14a-968b3b70b5d3 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:49:59.192172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f8d58661-b479-4752-b14a-968b3b70b5d3 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:49:59.201174 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8d58661-b479-4752-b14a-968b3b70b5d3 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:59.201633 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8d58661-b479-4752-b14a-968b3b70b5d3 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:59.202590 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8d58661-b479-4752-b14a-968b3b70b5d3 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:49:59.203102 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8d58661-b479-4752-b14a-968b3b70b5d3 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:49:59.211059 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:49:59.520681 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:59.533953 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:59.536228 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f8d58661-b479-4752-b14a-968b3b70b5d3 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:59.536391 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:49:59.538173 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4753fbcd-91b3-487b-93bb-156a0b3b3554 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.363346 Jun 08 13:49:59.539427 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 191/384] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:49:59 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:49:59.559574 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f8d58661-b479-4752-b14a-968b3b70b5d3 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.372530 Jun 08 13:49:59.569550 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 194/385] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:49:59 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:00.559621 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:00.562288 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:00.569227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:00.569977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:00.572470 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:00.572933 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:00.583401 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-acb5548f-7243-4fd2-a285-f5e30afad04c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:00.585079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-acb5548f-7243-4fd2-a285-f5e30afad04c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:00.595467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-acb5548f-7243-4fd2-a285-f5e30afad04c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:00.596422 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-acb5548f-7243-4fd2-a285-f5e30afad04c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:00.597498 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-acb5548f-7243-4fd2-a285-f5e30afad04c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:00.598101 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-acb5548f-7243-4fd2-a285-f5e30afad04c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:00.601129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=100 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:00.838259 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:00.842122 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-acb5548f-7243-4fd2-a285-f5e30afad04c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:00.855551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-acb5548f-7243-4fd2-a285-f5e30afad04c tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.281505 Jun 08 13:50:00.863069 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:00.863706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 195/386] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:00 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:00.870107 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:00.871507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8910176e-b655-46ec-871c-de7f55089faf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.316720 Jun 08 13:50:00.873150 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 192/387] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:00 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:50:01.889875 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e5f8d215-1281-47f4-9ff1-cb3b45107f57 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:01.890841 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e5f8d215-1281-47f4-9ff1-cb3b45107f57 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:01.900016 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5f8d215-1281-47f4-9ff1-cb3b45107f57 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:01.900532 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:01.901476 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:01.902656 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5f8d215-1281-47f4-9ff1-cb3b45107f57 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:01.908428 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5f8d215-1281-47f4-9ff1-cb3b45107f57 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:01.909325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5f8d215-1281-47f4-9ff1-cb3b45107f57 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:01.910358 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:01.910823 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:01.916310 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:01.921950 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:02.190707 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e5f8d215-1281-47f4-9ff1-cb3b45107f57 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:02.203825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e5f8d215-1281-47f4-9ff1-cb3b45107f57 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1319 microversion: 2.1 time: 0.327476 Jun 08 13:50:02.208385 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:02.222858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 196/388] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:01 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:02.243346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:02.245375 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:02.247177 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ccf32dae-6df4-4c79-a6cb-50ee62bf61e6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.358925 Jun 08 13:50:02.263254 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 193/389] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:01 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:50:03.227311 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-636b15e2-a834-4f0d-8906-71d99082b173 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:03.231042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-636b15e2-a834-4f0d-8906-71d99082b173 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:03.237893 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-636b15e2-a834-4f0d-8906-71d99082b173 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:03.238775 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-636b15e2-a834-4f0d-8906-71d99082b173 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:03.243358 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-636b15e2-a834-4f0d-8906-71d99082b173 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:03.244665 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-636b15e2-a834-4f0d-8906-71d99082b173 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:03.271925 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:03.273023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:03.294012 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:03.302398 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:03.304876 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:03.305510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:03.568690 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-636b15e2-a834-4f0d-8906-71d99082b173 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:03.584820 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-636b15e2-a834-4f0d-8906-71d99082b173 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1509 microversion: 2.1 time: 0.361604 Jun 08 13:50:03.586023 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 197/390] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:03 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:03.591241 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a0f9c8e6-21a6-43cf-9ddc-85a67a50aafb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:03.605112 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a0f9c8e6-21a6-43cf-9ddc-85a67a50aafb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:03.609126 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a0f9c8e6-21a6-43cf-9ddc-85a67a50aafb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:03.638081 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:03.652459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:03.654221 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:03.656416 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a8190195-2aa0-465e-8ae0-0d7db474bc62 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.388906 Jun 08 13:50:03.656952 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a0f9c8e6-21a6-43cf-9ddc-85a67a50aafb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Going to try to stop instance {{(pid=124629) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 08 13:50:03.657810 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 194/391] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:03 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:50:03.663405 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e84259a5-8c6d-4a99-b1fb-192388a0e5ce tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2d9f939-9be8-491e-b493-2a38adf0d9f0", "device": "/dev/sdb"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:03.665037 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e84259a5-8c6d-4a99-b1fb-192388a0e5ce tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:03.673140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e84259a5-8c6d-4a99-b1fb-192388a0e5ce tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:03.673936 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e84259a5-8c6d-4a99-b1fb-192388a0e5ce tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:03.675235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e84259a5-8c6d-4a99-b1fb-192388a0e5ce tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:03.675836 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e84259a5-8c6d-4a99-b1fb-192388a0e5ce tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:03.947655 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a0f9c8e6-21a6-43cf-9ddc-85a67a50aafb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/action" status: 202 len: 0 microversion: 2.1 time: 0.360221 Jun 08 13:50:03.948656 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 198/392] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:50:03 2022] POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:50:03.960116 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-76add935-b3a0-4541-beff-25fb76babec0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:03.960827 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-76add935-b3a0-4541-beff-25fb76babec0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:03.968096 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-76add935-b3a0-4541-beff-25fb76babec0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:03.968566 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-76add935-b3a0-4541-beff-25fb76babec0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:03.969433 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-76add935-b3a0-4541-beff-25fb76babec0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:03.969868 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-76add935-b3a0-4541-beff-25fb76babec0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:04.138076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-76add935-b3a0-4541-beff-25fb76babec0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:04.147484 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-76add935-b3a0-4541-beff-25fb76babec0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1722 microversion: 2.1 time: 0.193859 Jun 08 13:50:04.149896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 199/393] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:03 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:04.551525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e7984df5-0cf3-4800-87f3-c10246878511 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b8f962d-8544-48ff-bb7d-38ace7613cc6"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:04.554521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e7984df5-0cf3-4800-87f3-c10246878511 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:04.561376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7984df5-0cf3-4800-87f3-c10246878511 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:04.562210 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7984df5-0cf3-4800-87f3-c10246878511 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:04.563375 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7984df5-0cf3-4800-87f3-c10246878511 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:04.563812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7984df5-0cf3-4800-87f3-c10246878511 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:07.746587 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e7984df5-0cf3-4800-87f3-c10246878511 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.199019 Jun 08 13:50:07.759431 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 200/394] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:50:04 2022] POST /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments => generated 194 bytes in 3201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:50:07.759431 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:07.759431 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:07.759974 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:07.760353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:07.761662 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:07.762275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:07.918423 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:07.929163 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:07.931047 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:07.932536 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-541382f4-c8b9-41bb-a170-56dbf7bffa5c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.184191 Jun 08 13:50:07.933258 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 201/395] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:07 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:50:07.938158 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e84259a5-8c6d-4a99-b1fb-192388a0e5ce tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "POST /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.278820 Jun 08 13:50:07.938753 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9278877f-bfc9-47a0-ac09-e65be59f5fba tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:07.939047 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 195/396] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:50:03 2022] POST /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb/os-volume_attachments => generated 194 bytes in 4280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:50:07.939489 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9278877f-bfc9-47a0-ac09-e65be59f5fba tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:07.949985 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9278877f-bfc9-47a0-ac09-e65be59f5fba tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:07.950943 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9278877f-bfc9-47a0-ac09-e65be59f5fba tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:07.951798 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9278877f-bfc9-47a0-ac09-e65be59f5fba tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:07.952280 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9278877f-bfc9-47a0-ac09-e65be59f5fba tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:08.196782 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9278877f-bfc9-47a0-ac09-e65be59f5fba tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:08.210568 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9278877f-bfc9-47a0-ac09-e65be59f5fba tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1676 microversion: 2.1 time: 0.276248 Jun 08 13:50:08.211150 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 202/397] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:07 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1676 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:08.296629 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-56434795-f4be-4f2c-9607-0c9073f19f5b req-fb9857ee-e266-43d1-b79f-7d62f9b65edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac779098-8aa5-40b8-ae7d-dc4e463f015b", "name": "network-vif-plugged", "status": "completed", "tag": "a0a7ddb0-7def-4156-9a5b-f3b477a1c311"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:08.310078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-56434795-f4be-4f2c-9607-0c9073f19f5b req-fb9857ee-e266-43d1-b79f-7d62f9b65edf service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:08.310809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-56434795-f4be-4f2c-9607-0c9073f19f5b req-fb9857ee-e266-43d1-b79f-7d62f9b65edf service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:08.322255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-56434795-f4be-4f2c-9607-0c9073f19f5b req-fb9857ee-e266-43d1-b79f-7d62f9b65edf service nova] Creating event network-vif-plugged:a0a7ddb0-7def-4156-9a5b-f3b477a1c311 for instance ac779098-8aa5-40b8-ae7d-dc4e463f015b on hv-cinder-81914 Jun 08 13:50:08.327360 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-56434795-f4be-4f2c-9607-0c9073f19f5b req-fb9857ee-e266-43d1-b79f-7d62f9b65edf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036398 Jun 08 13:50:08.328248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 196/398] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:50:08.956755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:08.958103 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:08.969710 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:08.993100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:08.993100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:08.993100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:09.150661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:09.160302 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:09.161829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:09.163206 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-62296668-c4b8-41a2-bcba-bcb63018117a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.210357 Jun 08 13:50:09.164026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 203/399] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:08 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:50:09.230382 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9cfb8892-8c3e-4e55-8bc4-d3a03380cb1e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:09.232406 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-9cfb8892-8c3e-4e55-8bc4-d3a03380cb1e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:09.245460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9cfb8892-8c3e-4e55-8bc4-d3a03380cb1e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:09.245940 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9cfb8892-8c3e-4e55-8bc4-d3a03380cb1e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:09.246719 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9cfb8892-8c3e-4e55-8bc4-d3a03380cb1e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:09.247163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9cfb8892-8c3e-4e55-8bc4-d3a03380cb1e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:09.410574 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-9cfb8892-8c3e-4e55-8bc4-d3a03380cb1e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:09.421218 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9cfb8892-8c3e-4e55-8bc4-d3a03380cb1e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1676 microversion: 2.1 time: 0.194930 Jun 08 13:50:09.422490 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 197/400] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:09 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:10.182723 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:10.183361 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:10.196040 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:10.197309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:10.198581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:10.199316 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:10.357302 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:10.366904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:10.368431 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:10.369811 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-dd492e7d-51c8-49f8-ada5-ee3cf9f04fbc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.192158 Jun 08 13:50:10.370711 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 204/401] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:10 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:50:10.440667 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-18cb40e5-edae-4706-8033-2b1cd6fd5a84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:10.445610 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-18cb40e5-edae-4706-8033-2b1cd6fd5a84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:10.448178 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-18cb40e5-edae-4706-8033-2b1cd6fd5a84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:10.448708 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-18cb40e5-edae-4706-8033-2b1cd6fd5a84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:10.449562 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-18cb40e5-edae-4706-8033-2b1cd6fd5a84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:10.450945 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-18cb40e5-edae-4706-8033-2b1cd6fd5a84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:10.698137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-18cb40e5-edae-4706-8033-2b1cd6fd5a84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:10.708564 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-18cb40e5-edae-4706-8033-2b1cd6fd5a84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1676 microversion: 2.1 time: 0.272455 Jun 08 13:50:10.709665 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 198/402] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:10 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1676 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:11.388251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:11.388867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:11.395864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:11.397208 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:11.406316 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:11.406316 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:11.541146 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:11.553878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:11.557331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:11.559383 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-47eb69f1-8efd-4c83-bfec-74521917ee23 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.174584 Jun 08 13:50:11.560498 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 205/403] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:11 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:50:11.726201 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-aeedce3b-f141-4cea-ac0e-93c25cb6125a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:11.726977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-aeedce3b-f141-4cea-ac0e-93c25cb6125a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:11.733960 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-aeedce3b-f141-4cea-ac0e-93c25cb6125a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:11.734543 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-aeedce3b-f141-4cea-ac0e-93c25cb6125a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:11.735429 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-aeedce3b-f141-4cea-ac0e-93c25cb6125a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:11.735941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-aeedce3b-f141-4cea-ac0e-93c25cb6125a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:11.886263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-aeedce3b-f141-4cea-ac0e-93c25cb6125a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:11.904570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-aeedce3b-f141-4cea-ac0e-93c25cb6125a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1676 microversion: 2.1 time: 0.175669 Jun 08 13:50:11.912048 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 199/404] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:11 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:12.578541 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:12.579206 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:12.581625 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=56 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:12.586530 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:12.586971 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:12.587873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:12.588321 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:12.728308 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7dc2b12a-70f8-48c7-abd2-be5166f55935 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Action: 'create', calling method: .version_select at 0x7fe289660ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1082643024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjGuOl8n5GPhwK6ynC0kgQTlJET/NfF6b6xrAmvzWfddBHPcqE94AOR9AwH9e9jpP0N++pKXRbSlD/JosT4m70hjY1bip+zoQBYN1CY2PngIW7Uj8efdcM4GBprFenwA=="}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:12.739792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:12.741126 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:12.742739 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:12.742880 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-7dc2b12a-70f8-48c7-abd2-be5166f55935 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Getting quotas for project 14385fc22a1d4de4bc0af0c764f6ef69. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:50:12.743873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3a84950c-0c93-441b-bb54-dcd58b8dc374 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1805 microversion: 2.20 time: 0.169502 Jun 08 13:50:12.744456 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 206/405] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:12 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:50:12.746686 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-7dc2b12a-70f8-48c7-abd2-be5166f55935 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Getting quotas for user d6bd0d1fd6be41a3a711be3fb4c0cbfc and project 14385fc22a1d4de4bc0af0c764f6ef69. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:50:12.851486 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7dc2b12a-70f8-48c7-abd2-be5166f55935 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.127118 Jun 08 13:50:12.852109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 200/406] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 13:50:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:50:12.901017 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-628423675", "imageRef": "d0100973-4225-4c55-a06c-cffe4b32d072", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1082643024", "networks": [{"uuid": "c89f5e55-1486-4a8c-8616-1c7f2554f4f0"}]}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:12.915293 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f23d7205-f3a6-4e07-88ae-9bf61a9052e1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:12.915907 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f23d7205-f3a6-4e07-88ae-9bf61a9052e1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:12.935656 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f23d7205-f3a6-4e07-88ae-9bf61a9052e1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:12.937392 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f23d7205-f3a6-4e07-88ae-9bf61a9052e1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:12.938252 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f23d7205-f3a6-4e07-88ae-9bf61a9052e1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:12.950220 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f23d7205-f3a6-4e07-88ae-9bf61a9052e1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:12.960755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] validate_networks() for [('c89f5e55-1486-4a8c-8616-1c7f2554f4f0', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:50:13.184428 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f23d7205-f3a6-4e07-88ae-9bf61a9052e1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:13.193881 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f23d7205-f3a6-4e07-88ae-9bf61a9052e1 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1676 microversion: 2.1 time: 0.281727 Jun 08 13:50:13.193978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 201/407] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:12 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1676 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:13.431227 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:50:13.431701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:50:13.432683 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:50:13.432683 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:50:13.433051 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:50:13.446706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:13.454236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:13.454236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:13.454236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:13.466562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Getting quotas for project 14385fc22a1d4de4bc0af0c764f6ef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:50:13.471674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Getting quotas for user d6bd0d1fd6be41a3a711be3fb4c0cbfc and project 14385fc22a1d4de4bc0af0c764f6ef69. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:50:13.483303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:50:13.485954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0100973-4225-4c55-a06c-cffe4b32d072',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:50:13.618687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b65a8a62-cb67-495b-aba1-7325a778d813 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721362 Jun 08 13:50:13.619330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 207/408] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 08 13:50:13.629134 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-fad4bbb8-1126-4f9d-907c-a23500de70f7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:13.632560 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-fad4bbb8-1126-4f9d-907c-a23500de70f7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:13.700484 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-fad4bbb8-1126-4f9d-907c-a23500de70f7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:13.708845 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-fad4bbb8-1126-4f9d-907c-a23500de70f7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1258 microversion: 2.1 time: 0.083345 Jun 08 13:50:13.713032 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 202/409] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:13 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:13.765241 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:13.765859 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:13.772376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:13.772851 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:13.774184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:13.774649 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:13.944951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:13.955902 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:13.957506 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:13.958751 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f2ad7fb6-7398-4e39-b8c0-331196694d22 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1792 microversion: 2.20 time: 0.199574 Jun 08 13:50:13.959442 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 208/410] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:13 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1792 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:50:14.211948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-da00cb0f-fd40-4b25-bf79-74b155ce6d6b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:14.212616 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-da00cb0f-fd40-4b25-bf79-74b155ce6d6b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:14.219039 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-da00cb0f-fd40-4b25-bf79-74b155ce6d6b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:14.219544 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-da00cb0f-fd40-4b25-bf79-74b155ce6d6b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:14.220350 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-da00cb0f-fd40-4b25-bf79-74b155ce6d6b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:14.220800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-da00cb0f-fd40-4b25-bf79-74b155ce6d6b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:14.362444 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-da00cb0f-fd40-4b25-bf79-74b155ce6d6b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:14.369955 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-da00cb0f-fd40-4b25-bf79-74b155ce6d6b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1676 microversion: 2.1 time: 0.162326 Jun 08 13:50:14.370520 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 203/411] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:14 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:14.727143 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-34ca571b-971e-46d1-aac6-7b9f4f69e076 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:14.727767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-34ca571b-971e-46d1-aac6-7b9f4f69e076 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:14.780383 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-34ca571b-971e-46d1-aac6-7b9f4f69e076 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:14.787085 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-34ca571b-971e-46d1-aac6-7b9f4f69e076 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1258 microversion: 2.1 time: 0.063962 Jun 08 13:50:14.787647 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 209/412] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:14 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:15.319434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-02efd388-3b0e-4668-8024-589416c6e4e9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:15.320623 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-02efd388-3b0e-4668-8024-589416c6e4e9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:15.323025 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:15.333523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-02efd388-3b0e-4668-8024-589416c6e4e9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:15.333523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-02efd388-3b0e-4668-8024-589416c6e4e9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:15.333523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-02efd388-3b0e-4668-8024-589416c6e4e9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:15.333523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-02efd388-3b0e-4668-8024-589416c6e4e9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:15.356371 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-02efd388-3b0e-4668-8024-589416c6e4e9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lazy-loading 'flavor' on Instance uuid 777c65ea-2412-4080-9c2c-ee5201184c1e {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:50:15.387870 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-07cac787-7365-44c5-9894-6dcc79bfed82 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:15.388530 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-07cac787-7365-44c5-9894-6dcc79bfed82 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:15.395352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-07cac787-7365-44c5-9894-6dcc79bfed82 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:15.395806 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-07cac787-7365-44c5-9894-6dcc79bfed82 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:15.402715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-07cac787-7365-44c5-9894-6dcc79bfed82 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:15.402715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-07cac787-7365-44c5-9894-6dcc79bfed82 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:15.550848 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-07cac787-7365-44c5-9894-6dcc79bfed82 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:15.559786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-07cac787-7365-44c5-9894-6dcc79bfed82 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1676 microversion: 2.1 time: 0.175614 Jun 08 13:50:15.560391 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 210/413] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:15 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:15.660710 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-02efd388-3b0e-4668-8024-589416c6e4e9 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/action" status: 200 len: 32 microversion: 2.1 time: 0.345216 Jun 08 13:50:15.661378 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 204/414] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:50:15 2022] POST /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/action => generated 32 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:50:15.670721 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c354c2b2-e43d-4c95-ad25-7073fc0d8e96 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:15.671530 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c354c2b2-e43d-4c95-ad25-7073fc0d8e96 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:15.677817 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c354c2b2-e43d-4c95-ad25-7073fc0d8e96 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:15.678273 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c354c2b2-e43d-4c95-ad25-7073fc0d8e96 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:15.679049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c354c2b2-e43d-4c95-ad25-7073fc0d8e96 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:15.679492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c354c2b2-e43d-4c95-ad25-7073fc0d8e96 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:15.684535 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:15.804915 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6f8b2879-85ec-4922-9f78-c838356ce1bc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:15.805638 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6f8b2879-85ec-4922-9f78-c838356ce1bc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:15.810379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c354c2b2-e43d-4c95-ad25-7073fc0d8e96 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:15.813533 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f8b2879-85ec-4922-9f78-c838356ce1bc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:15.813991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f8b2879-85ec-4922-9f78-c838356ce1bc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:15.814782 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f8b2879-85ec-4922-9f78-c838356ce1bc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:15.815223 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f8b2879-85ec-4922-9f78-c838356ce1bc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:15.819653 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c354c2b2-e43d-4c95-ad25-7073fc0d8e96 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.152963 Jun 08 13:50:15.820260 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 211/415] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:15 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:15.877281 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6f8b2879-85ec-4922-9f78-c838356ce1bc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:15.884826 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6f8b2879-85ec-4922-9f78-c838356ce1bc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1254 microversion: 2.1 time: 0.084368 Jun 08 13:50:15.885397 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 205/416] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:15 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1254 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:16.577264 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8e348479-e04e-4b99-b5b9-3c9d3713c2b3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:16.577898 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8e348479-e04e-4b99-b5b9-3c9d3713c2b3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:16.585863 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8e348479-e04e-4b99-b5b9-3c9d3713c2b3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:16.586438 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8e348479-e04e-4b99-b5b9-3c9d3713c2b3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:16.587325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8e348479-e04e-4b99-b5b9-3c9d3713c2b3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:16.587825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8e348479-e04e-4b99-b5b9-3c9d3713c2b3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:16.731733 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8e348479-e04e-4b99-b5b9-3c9d3713c2b3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:16.739976 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8e348479-e04e-4b99-b5b9-3c9d3713c2b3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1676 microversion: 2.1 time: 0.166653 Jun 08 13:50:16.740596 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 212/417] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:16 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:16.838193 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b6d60463-510d-4a57-94f9-79e9a14020d4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:16.838799 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b6d60463-510d-4a57-94f9-79e9a14020d4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:16.847573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b6d60463-510d-4a57-94f9-79e9a14020d4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:16.848021 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b6d60463-510d-4a57-94f9-79e9a14020d4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:16.849043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b6d60463-510d-4a57-94f9-79e9a14020d4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:16.849472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b6d60463-510d-4a57-94f9-79e9a14020d4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:16.903287 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d2e48cd4-e600-431e-bdca-47adadb50971 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:16.905472 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d2e48cd4-e600-431e-bdca-47adadb50971 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:16.913175 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d2e48cd4-e600-431e-bdca-47adadb50971 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:16.913968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d2e48cd4-e600-431e-bdca-47adadb50971 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:16.915768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d2e48cd4-e600-431e-bdca-47adadb50971 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:16.916543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d2e48cd4-e600-431e-bdca-47adadb50971 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:16.995146 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d2e48cd4-e600-431e-bdca-47adadb50971 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:17.003596 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d2e48cd4-e600-431e-bdca-47adadb50971 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1318 microversion: 2.1 time: 0.104296 Jun 08 13:50:17.004408 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 213/418] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:16 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:17.022465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b6d60463-510d-4a57-94f9-79e9a14020d4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:17.031596 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b6d60463-510d-4a57-94f9-79e9a14020d4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.197404 Jun 08 13:50:17.032174 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 206/419] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:16 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:17.758160 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-16ff0717-78e8-48fd-a190-78c81ccc53c9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:17.759057 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-16ff0717-78e8-48fd-a190-78c81ccc53c9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:17.767457 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16ff0717-78e8-48fd-a190-78c81ccc53c9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:17.768281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16ff0717-78e8-48fd-a190-78c81ccc53c9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:17.769449 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16ff0717-78e8-48fd-a190-78c81ccc53c9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:17.770113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16ff0717-78e8-48fd-a190-78c81ccc53c9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:17.973283 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-16ff0717-78e8-48fd-a190-78c81ccc53c9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:17.983586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-16ff0717-78e8-48fd-a190-78c81ccc53c9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1653 microversion: 2.1 time: 0.229491 Jun 08 13:50:17.984467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 214/420] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:17 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1653 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:18.002389 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f9c8b593-b06e-42f0-b280-c8f90f92f9a8 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:18.011753 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9c8b593-b06e-42f0-b280-c8f90f92f9a8 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:18.012566 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9c8b593-b06e-42f0-b280-c8f90f92f9a8 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:18.022531 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f9053dd6-0160-49ff-925f-6eb2fe58acf1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:18.023137 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f9053dd6-0160-49ff-925f-6eb2fe58acf1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:18.035477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f9053dd6-0160-49ff-925f-6eb2fe58acf1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:18.035941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f9053dd6-0160-49ff-925f-6eb2fe58acf1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:18.039291 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:18.040755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f9053dd6-0160-49ff-925f-6eb2fe58acf1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:18.041211 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f9053dd6-0160-49ff-925f-6eb2fe58acf1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:18.049273 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f9c8b593-b06e-42f0-b280-c8f90f92f9a8 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Going to try to start instance {{(pid=124628) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 08 13:50:18.270558 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f9053dd6-0160-49ff-925f-6eb2fe58acf1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:18.273949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f9c8b593-b06e-42f0-b280-c8f90f92f9a8 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/action" status: 202 len: 0 microversion: 2.1 time: 0.276196 Jun 08 13:50:18.274658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 207/421] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:50:17 2022] POST /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:50:18.282977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-aa2a0cfb-3757-45df-9a95-8d7800ade0af tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:18.284258 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-aa2a0cfb-3757-45df-9a95-8d7800ade0af tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:18.284564 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f9053dd6-0160-49ff-925f-6eb2fe58acf1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.264814 Jun 08 13:50:18.298095 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 215/422] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:18 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:18.299890 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-aa2a0cfb-3757-45df-9a95-8d7800ade0af tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:18.300513 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-aa2a0cfb-3757-45df-9a95-8d7800ade0af tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:18.301874 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-aa2a0cfb-3757-45df-9a95-8d7800ade0af tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:18.303462 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-aa2a0cfb-3757-45df-9a95-8d7800ade0af tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:18.305913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8ff7badf-b98b-47f9-83a3-5cf91bd9790d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:18.306902 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8ff7badf-b98b-47f9-83a3-5cf91bd9790d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:18.315887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8ff7badf-b98b-47f9-83a3-5cf91bd9790d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:18.316640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8ff7badf-b98b-47f9-83a3-5cf91bd9790d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:18.317589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8ff7badf-b98b-47f9-83a3-5cf91bd9790d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:18.318231 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8ff7badf-b98b-47f9-83a3-5cf91bd9790d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:18.583512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8ff7badf-b98b-47f9-83a3-5cf91bd9790d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:18.589925 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8ff7badf-b98b-47f9-83a3-5cf91bd9790d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.290011 Jun 08 13:50:18.601059 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-aa2a0cfb-3757-45df-9a95-8d7800ade0af tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:18.601625 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 216/423] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:18 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:18.608855 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-aa2a0cfb-3757-45df-9a95-8d7800ade0af tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.332675 Jun 08 13:50:18.610192 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 208/424] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:18 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:19.040758 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-92f8cfd7-677f-49bc-907c-d32c6cd7fa52 req-b6679f26-1ef1-48b2-998f-01524801b360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ed7b73-7978-4c81-84f1-53d223ad842f", "tag": "86e5c27b-3254-42aa-9d0f-5a43c944241b"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:19.060674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-92f8cfd7-677f-49bc-907c-d32c6cd7fa52 req-b6679f26-1ef1-48b2-998f-01524801b360 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:19.061155 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-92f8cfd7-677f-49bc-907c-d32c6cd7fa52 req-b6679f26-1ef1-48b2-998f-01524801b360 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:19.102392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-92f8cfd7-677f-49bc-907c-d32c6cd7fa52 req-b6679f26-1ef1-48b2-998f-01524801b360 service nova] Creating event network-changed:86e5c27b-3254-42aa-9d0f-5a43c944241b for instance 08ed7b73-7978-4c81-84f1-53d223ad842f on hv-cinder-81914 Jun 08 13:50:19.109895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-92f8cfd7-677f-49bc-907c-d32c6cd7fa52 req-b6679f26-1ef1-48b2-998f-01524801b360 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072642 Jun 08 13:50:19.116914 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 217/425] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:50:19.303537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3da7cd25-5d46-43f6-ad70-566ac4565ef3 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:19.304331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3da7cd25-5d46-43f6-ad70-566ac4565ef3 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:19.311248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3da7cd25-5d46-43f6-ad70-566ac4565ef3 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:19.322446 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3da7cd25-5d46-43f6-ad70-566ac4565ef3 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:19.323537 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3da7cd25-5d46-43f6-ad70-566ac4565ef3 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:19.323971 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3da7cd25-5d46-43f6-ad70-566ac4565ef3 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:19.612238 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-88a029cc-c0fc-4786-b859-4be3e2ff2865 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:19.613619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-88a029cc-c0fc-4786-b859-4be3e2ff2865 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:19.625076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-88a029cc-c0fc-4786-b859-4be3e2ff2865 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:19.629674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-88a029cc-c0fc-4786-b859-4be3e2ff2865 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:19.629674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-88a029cc-c0fc-4786-b859-4be3e2ff2865 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:19.629674 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-88a029cc-c0fc-4786-b859-4be3e2ff2865 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:19.744167 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3da7cd25-5d46-43f6-ad70-566ac4565ef3 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:19.763902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3da7cd25-5d46-43f6-ad70-566ac4565ef3 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.454826 Jun 08 13:50:19.763902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 209/426] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:19 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:19.771026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8117537f-de8f-4a65-948f-b814cec9d698 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:19.772970 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8117537f-de8f-4a65-948f-b814cec9d698 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:19.793282 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8117537f-de8f-4a65-948f-b814cec9d698 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:19.793743 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8117537f-de8f-4a65-948f-b814cec9d698 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:19.794522 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8117537f-de8f-4a65-948f-b814cec9d698 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:19.794964 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8117537f-de8f-4a65-948f-b814cec9d698 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:19.830649 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-88a029cc-c0fc-4786-b859-4be3e2ff2865 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:19.839121 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-88a029cc-c0fc-4786-b859-4be3e2ff2865 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.233810 Jun 08 13:50:19.848089 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 218/427] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:19 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:19.954823 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8117537f-de8f-4a65-948f-b814cec9d698 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:19.963767 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8117537f-de8f-4a65-948f-b814cec9d698 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.207047 Jun 08 13:50:19.964725 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 210/428] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:19 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:20.771724 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-576a5e93-40eb-4277-8925-03ca001a6bbb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:20.773052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-576a5e93-40eb-4277-8925-03ca001a6bbb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:20.780203 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-576a5e93-40eb-4277-8925-03ca001a6bbb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:20.781492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-576a5e93-40eb-4277-8925-03ca001a6bbb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:20.783116 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-576a5e93-40eb-4277-8925-03ca001a6bbb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:20.783655 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-576a5e93-40eb-4277-8925-03ca001a6bbb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:20.857778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a6b0ce85-aaf0-48c6-a236-303503112c80 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:20.858515 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a6b0ce85-aaf0-48c6-a236-303503112c80 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:20.865267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a6b0ce85-aaf0-48c6-a236-303503112c80 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:20.865723 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a6b0ce85-aaf0-48c6-a236-303503112c80 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:20.866680 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a6b0ce85-aaf0-48c6-a236-303503112c80 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:20.867294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a6b0ce85-aaf0-48c6-a236-303503112c80 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:20.965778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-576a5e93-40eb-4277-8925-03ca001a6bbb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:20.973547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-576a5e93-40eb-4277-8925-03ca001a6bbb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.206130 Jun 08 13:50:20.974124 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 219/429] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:20 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:20.982371 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b199c724-88a5-4bd8-88cd-b3aef711e8a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:20.983366 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b199c724-88a5-4bd8-88cd-b3aef711e8a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:20.990893 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b199c724-88a5-4bd8-88cd-b3aef711e8a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:20.991465 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b199c724-88a5-4bd8-88cd-b3aef711e8a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:20.992428 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b199c724-88a5-4bd8-88cd-b3aef711e8a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:20.992869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b199c724-88a5-4bd8-88cd-b3aef711e8a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:21.076617 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a6b0ce85-aaf0-48c6-a236-303503112c80 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:21.084939 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a6b0ce85-aaf0-48c6-a236-303503112c80 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.231356 Jun 08 13:50:21.085484 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 211/430] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:20 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:21.148856 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b199c724-88a5-4bd8-88cd-b3aef711e8a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:21.158752 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b199c724-88a5-4bd8-88cd-b3aef711e8a7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.180737 Jun 08 13:50:21.159913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 220/431] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:20 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:21.990909 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4c150842-b900-4d2d-8fab-3ea1da72cb0b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:21.991732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4c150842-b900-4d2d-8fab-3ea1da72cb0b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:21.998399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4c150842-b900-4d2d-8fab-3ea1da72cb0b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:21.998856 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4c150842-b900-4d2d-8fab-3ea1da72cb0b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:22.000378 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4c150842-b900-4d2d-8fab-3ea1da72cb0b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:22.000879 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4c150842-b900-4d2d-8fab-3ea1da72cb0b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:22.107459 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-498785af-c08c-4e84-add8-aa1c050bc591 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:22.108339 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-498785af-c08c-4e84-add8-aa1c050bc591 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:22.115686 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-498785af-c08c-4e84-add8-aa1c050bc591 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:22.116228 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-498785af-c08c-4e84-add8-aa1c050bc591 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:22.116951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-498785af-c08c-4e84-add8-aa1c050bc591 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:22.117386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-498785af-c08c-4e84-add8-aa1c050bc591 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:22.171784 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4c150842-b900-4d2d-8fab-3ea1da72cb0b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:22.179124 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4c150842-b900-4d2d-8fab-3ea1da72cb0b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.192118 Jun 08 13:50:22.179697 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 212/432] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:21 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:22.184173 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-503358f5-8787-40d8-b0d6-19c08bbd564c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:22.184789 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-503358f5-8787-40d8-b0d6-19c08bbd564c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:22.192874 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-503358f5-8787-40d8-b0d6-19c08bbd564c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:22.196098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-503358f5-8787-40d8-b0d6-19c08bbd564c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:22.196098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-503358f5-8787-40d8-b0d6-19c08bbd564c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:22.196098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-503358f5-8787-40d8-b0d6-19c08bbd564c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:22.298133 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-498785af-c08c-4e84-add8-aa1c050bc591 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:22.305097 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-498785af-c08c-4e84-add8-aa1c050bc591 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.206105 Jun 08 13:50:22.306008 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 221/433] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:22 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:22.380974 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-503358f5-8787-40d8-b0d6-19c08bbd564c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:22.388859 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-503358f5-8787-40d8-b0d6-19c08bbd564c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.208202 Jun 08 13:50:22.389415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 213/434] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:22 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:23.197890 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-82786ff9-d8b1-4875-85c0-4c4fbf587e6d tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:23.198580 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-82786ff9-d8b1-4875-85c0-4c4fbf587e6d tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:23.206317 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82786ff9-d8b1-4875-85c0-4c4fbf587e6d tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:23.206763 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82786ff9-d8b1-4875-85c0-4c4fbf587e6d tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:23.207694 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82786ff9-d8b1-4875-85c0-4c4fbf587e6d tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:23.208163 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82786ff9-d8b1-4875-85c0-4c4fbf587e6d tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:23.323006 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4f99e38b-8e45-4091-b23d-a3814183f3e4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:23.323862 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4f99e38b-8e45-4091-b23d-a3814183f3e4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:23.331398 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4f99e38b-8e45-4091-b23d-a3814183f3e4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:23.331839 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4f99e38b-8e45-4091-b23d-a3814183f3e4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:23.332771 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4f99e38b-8e45-4091-b23d-a3814183f3e4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:23.333215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4f99e38b-8e45-4091-b23d-a3814183f3e4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:23.361834 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-82786ff9-d8b1-4875-85c0-4c4fbf587e6d tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:23.369810 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-82786ff9-d8b1-4875-85c0-4c4fbf587e6d tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.176237 Jun 08 13:50:23.370668 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 222/435] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:23 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:23.406619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a8bc191b-2239-4382-8721-c97e6ba25ae1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:23.407234 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a8bc191b-2239-4382-8721-c97e6ba25ae1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:23.413572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a8bc191b-2239-4382-8721-c97e6ba25ae1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:23.413987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a8bc191b-2239-4382-8721-c97e6ba25ae1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:23.414756 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a8bc191b-2239-4382-8721-c97e6ba25ae1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:23.415239 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a8bc191b-2239-4382-8721-c97e6ba25ae1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:23.457386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:23.515563 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4f99e38b-8e45-4091-b23d-a3814183f3e4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:23.525615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4f99e38b-8e45-4091-b23d-a3814183f3e4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.206584 Jun 08 13:50:23.526230 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 214/436] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:23 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:23.596502 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a8bc191b-2239-4382-8721-c97e6ba25ae1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:23.604567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a8bc191b-2239-4382-8721-c97e6ba25ae1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.201860 Jun 08 13:50:23.605357 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 223/437] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:23 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:24.388952 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2f53e7f5-00b7-43d8-9557-3300dea98ee8 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:24.389813 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2f53e7f5-00b7-43d8-9557-3300dea98ee8 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:24.392424 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=6 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:24.397824 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2f53e7f5-00b7-43d8-9557-3300dea98ee8 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:24.398277 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2f53e7f5-00b7-43d8-9557-3300dea98ee8 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:24.399048 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2f53e7f5-00b7-43d8-9557-3300dea98ee8 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:24.399484 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2f53e7f5-00b7-43d8-9557-3300dea98ee8 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:24.543263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2f53e7f5-00b7-43d8-9557-3300dea98ee8 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:24.546655 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-eb8ebb0e-ee2d-4779-a8f8-1c95ce4eec26 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:24.547716 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-eb8ebb0e-ee2d-4779-a8f8-1c95ce4eec26 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:24.554346 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eb8ebb0e-ee2d-4779-a8f8-1c95ce4eec26 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:24.554880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eb8ebb0e-ee2d-4779-a8f8-1c95ce4eec26 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:24.555719 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eb8ebb0e-ee2d-4779-a8f8-1c95ce4eec26 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:24.556268 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eb8ebb0e-ee2d-4779-a8f8-1c95ce4eec26 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:24.559825 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2f53e7f5-00b7-43d8-9557-3300dea98ee8 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.175173 Jun 08 13:50:24.561279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 215/438] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:24 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:24.624387 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0ca00e07-e892-4231-bd8e-a281b27c3f59 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:24.626493 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0ca00e07-e892-4231-bd8e-a281b27c3f59 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:24.633756 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0ca00e07-e892-4231-bd8e-a281b27c3f59 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:24.634159 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0ca00e07-e892-4231-bd8e-a281b27c3f59 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:24.634977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0ca00e07-e892-4231-bd8e-a281b27c3f59 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:24.635420 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0ca00e07-e892-4231-bd8e-a281b27c3f59 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:24.764885 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-eb8ebb0e-ee2d-4779-a8f8-1c95ce4eec26 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:24.795362 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-eb8ebb0e-ee2d-4779-a8f8-1c95ce4eec26 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.238280 Jun 08 13:50:24.796398 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 224/439] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:24 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:24.827916 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0ca00e07-e892-4231-bd8e-a281b27c3f59 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:24.837705 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0ca00e07-e892-4231-bd8e-a281b27c3f59 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.218693 Jun 08 13:50:24.838531 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 216/440] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:24 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:25.578546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3d024680-bae2-40ec-b2d7-d1e136cc0803 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:25.579165 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3d024680-bae2-40ec-b2d7-d1e136cc0803 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:25.581029 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=8 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:25.586323 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3d024680-bae2-40ec-b2d7-d1e136cc0803 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:25.586773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3d024680-bae2-40ec-b2d7-d1e136cc0803 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:25.587540 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3d024680-bae2-40ec-b2d7-d1e136cc0803 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:25.587994 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3d024680-bae2-40ec-b2d7-d1e136cc0803 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:25.725397 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3d024680-bae2-40ec-b2d7-d1e136cc0803 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:25.733226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3d024680-bae2-40ec-b2d7-d1e136cc0803 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.158775 Jun 08 13:50:25.736315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 225/441] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:25 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:25.813966 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4ba5c5c2-a63a-4504-a5e4-048c23ec01b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:25.814576 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4ba5c5c2-a63a-4504-a5e4-048c23ec01b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:25.821542 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4ba5c5c2-a63a-4504-a5e4-048c23ec01b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:25.821993 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4ba5c5c2-a63a-4504-a5e4-048c23ec01b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:25.822755 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4ba5c5c2-a63a-4504-a5e4-048c23ec01b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:25.823190 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4ba5c5c2-a63a-4504-a5e4-048c23ec01b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:25.856813 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-60a8905b-c20e-4d21-b698-270ee2259370 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:25.857421 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-60a8905b-c20e-4d21-b698-270ee2259370 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:25.864702 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-60a8905b-c20e-4d21-b698-270ee2259370 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:25.865158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-60a8905b-c20e-4d21-b698-270ee2259370 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:25.865976 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-60a8905b-c20e-4d21-b698-270ee2259370 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:25.866402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-60a8905b-c20e-4d21-b698-270ee2259370 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:26.002761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4ba5c5c2-a63a-4504-a5e4-048c23ec01b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:26.010203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4ba5c5c2-a63a-4504-a5e4-048c23ec01b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.200200 Jun 08 13:50:26.010800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 217/442] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:25 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:26.032416 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-60a8905b-c20e-4d21-b698-270ee2259370 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:26.040239 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-60a8905b-c20e-4d21-b698-270ee2259370 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.187585 Jun 08 13:50:26.040801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 226/443] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:25 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:26.751603 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-09a751be-5d99-484e-b3a0-e9b8829b2df7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:26.754356 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-09a751be-5d99-484e-b3a0-e9b8829b2df7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:26.758335 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-09a751be-5d99-484e-b3a0-e9b8829b2df7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:26.758817 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-09a751be-5d99-484e-b3a0-e9b8829b2df7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:26.759592 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-09a751be-5d99-484e-b3a0-e9b8829b2df7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:26.760030 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-09a751be-5d99-484e-b3a0-e9b8829b2df7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:26.887824 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-09a751be-5d99-484e-b3a0-e9b8829b2df7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:26.895392 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-09a751be-5d99-484e-b3a0-e9b8829b2df7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.149436 Jun 08 13:50:26.895948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 218/444] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:26 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:27.027933 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a5aeec8e-ddd1-4657-a87d-1b5dfbf453b6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:27.028497 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a5aeec8e-ddd1-4657-a87d-1b5dfbf453b6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:27.035690 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5aeec8e-ddd1-4657-a87d-1b5dfbf453b6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:27.036173 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5aeec8e-ddd1-4657-a87d-1b5dfbf453b6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:27.036938 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5aeec8e-ddd1-4657-a87d-1b5dfbf453b6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:27.037376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a5aeec8e-ddd1-4657-a87d-1b5dfbf453b6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:27.057244 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4a63f0e6-5070-436c-a0d9-0f548614a617 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:27.057855 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4a63f0e6-5070-436c-a0d9-0f548614a617 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:27.063873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4a63f0e6-5070-436c-a0d9-0f548614a617 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:27.064495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4a63f0e6-5070-436c-a0d9-0f548614a617 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:27.065254 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4a63f0e6-5070-436c-a0d9-0f548614a617 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:27.065689 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4a63f0e6-5070-436c-a0d9-0f548614a617 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:27.237771 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a5aeec8e-ddd1-4657-a87d-1b5dfbf453b6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:27.249227 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a5aeec8e-ddd1-4657-a87d-1b5dfbf453b6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.225051 Jun 08 13:50:27.252102 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 227/445] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:27 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:27.260943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4a63f0e6-5070-436c-a0d9-0f548614a617 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:27.269922 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4a63f0e6-5070-436c-a0d9-0f548614a617 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.216426 Jun 08 13:50:27.270501 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 219/446] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:27 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:27.912088 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-37bc6319-3d00-42ff-bc61-c652193a7473 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:27.912628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-37bc6319-3d00-42ff-bc61-c652193a7473 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:27.918595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37bc6319-3d00-42ff-bc61-c652193a7473 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:27.919013 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37bc6319-3d00-42ff-bc61-c652193a7473 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:27.919780 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37bc6319-3d00-42ff-bc61-c652193a7473 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:27.920252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37bc6319-3d00-42ff-bc61-c652193a7473 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:27.935037 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=100 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:28.050050 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-37bc6319-3d00-42ff-bc61-c652193a7473 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:28.057527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-37bc6319-3d00-42ff-bc61-c652193a7473 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.149409 Jun 08 13:50:28.059711 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 228/447] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:27 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:28.266300 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cf512782-7d97-41ae-96fb-4a2d9d463015 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:28.266911 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-cf512782-7d97-41ae-96fb-4a2d9d463015 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:28.273346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cf512782-7d97-41ae-96fb-4a2d9d463015 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:28.273796 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cf512782-7d97-41ae-96fb-4a2d9d463015 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:28.274554 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cf512782-7d97-41ae-96fb-4a2d9d463015 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:28.274993 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cf512782-7d97-41ae-96fb-4a2d9d463015 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:28.294509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9f3591b5-de1d-4556-b0fe-dae1ed9b166e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:28.295111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9f3591b5-de1d-4556-b0fe-dae1ed9b166e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:28.301745 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9f3591b5-de1d-4556-b0fe-dae1ed9b166e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:28.302188 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9f3591b5-de1d-4556-b0fe-dae1ed9b166e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:28.302941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9f3591b5-de1d-4556-b0fe-dae1ed9b166e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:28.303370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9f3591b5-de1d-4556-b0fe-dae1ed9b166e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:28.467227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-cf512782-7d97-41ae-96fb-4a2d9d463015 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:28.475846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-cf512782-7d97-41ae-96fb-4a2d9d463015 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.213359 Jun 08 13:50:28.476464 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 220/448] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:28 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:28.479367 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9f3591b5-de1d-4556-b0fe-dae1ed9b166e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:28.488274 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9f3591b5-de1d-4556-b0fe-dae1ed9b166e tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.197449 Jun 08 13:50:28.488838 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 229/449] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:28 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:29.074926 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-77e9ed89-2673-4e63-882e-b18adf805331 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:29.075536 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-77e9ed89-2673-4e63-882e-b18adf805331 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:29.082833 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-77e9ed89-2673-4e63-882e-b18adf805331 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:29.087892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-77e9ed89-2673-4e63-882e-b18adf805331 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:29.087892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-77e9ed89-2673-4e63-882e-b18adf805331 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:29.087892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-77e9ed89-2673-4e63-882e-b18adf805331 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:29.213902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-77e9ed89-2673-4e63-882e-b18adf805331 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:29.221948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-77e9ed89-2673-4e63-882e-b18adf805331 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.150770 Jun 08 13:50:29.222704 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 221/450] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:29 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:29.496386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c5df8809-aecf-444a-868b-ff3446748018 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:29.497303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c5df8809-aecf-444a-868b-ff3446748018 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:29.506972 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c5df8809-aecf-444a-868b-ff3446748018 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:29.507802 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c5df8809-aecf-444a-868b-ff3446748018 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:29.509160 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b074afb7-b272-461a-ba5e-1e3c8ae249fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:29.509797 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b074afb7-b272-461a-ba5e-1e3c8ae249fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:29.509960 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c5df8809-aecf-444a-868b-ff3446748018 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:29.510728 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c5df8809-aecf-444a-868b-ff3446748018 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:29.517465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b074afb7-b272-461a-ba5e-1e3c8ae249fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:29.517465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b074afb7-b272-461a-ba5e-1e3c8ae249fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:29.517465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b074afb7-b272-461a-ba5e-1e3c8ae249fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:29.517465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b074afb7-b272-461a-ba5e-1e3c8ae249fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:29.716613 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b074afb7-b272-461a-ba5e-1e3c8ae249fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:29.728971 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b074afb7-b272-461a-ba5e-1e3c8ae249fd tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1734 microversion: 2.1 time: 0.226195 Jun 08 13:50:29.729911 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 222/451] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:29 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:29.734073 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c5df8809-aecf-444a-868b-ff3446748018 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:29.742749 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c5df8809-aecf-444a-868b-ff3446748018 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.252691 Jun 08 13:50:29.743304 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 230/452] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:29 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:30.241212 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e6494511-5f2a-4690-8710-0a9c8d76eeaa tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:30.241911 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e6494511-5f2a-4690-8710-0a9c8d76eeaa tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:30.250943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e6494511-5f2a-4690-8710-0a9c8d76eeaa tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:30.251481 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e6494511-5f2a-4690-8710-0a9c8d76eeaa tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:30.252326 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e6494511-5f2a-4690-8710-0a9c8d76eeaa tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:30.252769 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e6494511-5f2a-4690-8710-0a9c8d76eeaa tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:30.257327 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:30.384678 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e6494511-5f2a-4690-8710-0a9c8d76eeaa tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:30.391964 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e6494511-5f2a-4690-8710-0a9c8d76eeaa tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.156776 Jun 08 13:50:30.392569 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 223/453] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:30 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:30.747009 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e9edf292-3c62-4f0c-a89d-22ad75935156 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:30.747532 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e9edf292-3c62-4f0c-a89d-22ad75935156 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:30.755356 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e9edf292-3c62-4f0c-a89d-22ad75935156 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:30.758324 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e9edf292-3c62-4f0c-a89d-22ad75935156 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:30.758324 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e9edf292-3c62-4f0c-a89d-22ad75935156 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:30.758324 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e9edf292-3c62-4f0c-a89d-22ad75935156 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:30.759888 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f9cbccf6-e98e-4ca6-b919-8e91ee272918 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:30.760542 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f9cbccf6-e98e-4ca6-b919-8e91ee272918 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:30.767429 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9cbccf6-e98e-4ca6-b919-8e91ee272918 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:30.767877 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9cbccf6-e98e-4ca6-b919-8e91ee272918 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:30.769244 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9cbccf6-e98e-4ca6-b919-8e91ee272918 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:30.769684 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9cbccf6-e98e-4ca6-b919-8e91ee272918 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:30.973318 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e9edf292-3c62-4f0c-a89d-22ad75935156 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:30.979727 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f9cbccf6-e98e-4ca6-b919-8e91ee272918 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:30.981466 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e9edf292-3c62-4f0c-a89d-22ad75935156 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1714 microversion: 2.1 time: 0.238590 Jun 08 13:50:30.982116 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 231/454] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:30 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1714 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:30.985626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f9cbccf6-e98e-4ca6-b919-8e91ee272918 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1662 microversion: 2.1 time: 0.229923 Jun 08 13:50:30.986189 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 224/455] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:30 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1662 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:31.085419 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:31.085931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:31.092221 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:31.095944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:31.095944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:31.095944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:31.175469 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] HTTP exception thrown: Cannot 'detach_volume' instance 777c65ea-2412-4080-9c2c-ee5201184c1e while it is in vm_state rescued Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Request method failure captured: Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: DELETE /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments/6b8f962d-8544-48ff-bb7d-38ace7613cc6 HTTP/1.1 Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKhWmfjOgbqK2CSJHSTKHI6IveJnrM8w8UarJX_JvlVysiZhXg0V18KvvGG7aQd3UMsLFAxPtqLUvG2Maio6jvXsfWlGOgxowjEe9EDmba_uZYDLft_fZhEENfYo3NaDrW-mUQ0ZlWIC2i-YGG46CWiTxjeCvMUZ7p4mPis_UMDRHL8 Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:50:31.177100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9abd79bc99784c3f81991d1cae37a074", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}] Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 85e0d647620a407cbe03d83c86111f3d Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:50:31.178701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Cannot 'detach_volume' instance 777c65ea-2412-4080-9c2c-ee5201184c1e while it is in vm_state rescued Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'server_id': '777c65ea-2412-4080-9c2c-ee5201184c1e', 'id': '6b8f962d-8544-48ff-bb7d-38ace7613cc6'} Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 777c65ea-2412-4080-9c2c-ee5201184c1e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:50:31.179512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 777c65ea-2412-4080-9c2c-ee5201184c1e while it is in vm_state rescued Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 777c65ea-2412-4080-9c2c-ee5201184c1e while it is in vm_state rescued Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:31.180996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Returning 409 to user: Cannot 'detach_volume' instance 777c65ea-2412-4080-9c2c-ee5201184c1e while it is in vm_state rescued {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:50:31.182433 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6a97961c-d485-4f68-a2f6-2d149b897d28 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "DELETE /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments/6b8f962d-8544-48ff-bb7d-38ace7613cc6" status: 409 len: 152 microversion: 2.1 time: 0.098248 Jun 08 13:50:31.182433 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 232/456] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:50:31 2022] DELETE /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments/6b8f962d-8544-48ff-bb7d-38ace7613cc6 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 08 13:50:31.187177 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8f477c39-6d04-4f92-ad7e-573bc37c7033 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:31.187704 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8f477c39-6d04-4f92-ad7e-573bc37c7033 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:31.194959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f477c39-6d04-4f92-ad7e-573bc37c7033 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:31.195402 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f477c39-6d04-4f92-ad7e-573bc37c7033 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:31.196190 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f477c39-6d04-4f92-ad7e-573bc37c7033 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:31.196628 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f477c39-6d04-4f92-ad7e-573bc37c7033 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:31.409368 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6058fa94-83c3-439d-bfc0-4071174491cc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:31.409984 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6058fa94-83c3-439d-bfc0-4071174491cc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:31.416712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6058fa94-83c3-439d-bfc0-4071174491cc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:31.417165 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6058fa94-83c3-439d-bfc0-4071174491cc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:31.417977 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6058fa94-83c3-439d-bfc0-4071174491cc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:31.418412 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6058fa94-83c3-439d-bfc0-4071174491cc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:31.456470 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8f477c39-6d04-4f92-ad7e-573bc37c7033 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "POST /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/action" status: 202 len: 0 microversion: 2.1 time: 0.272822 Jun 08 13:50:31.458931 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 225/457] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:50:31 2022] POST /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 13:50:31.465769 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7bc7d13f-3024-41b6-83bd-8becd1bd9ad2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:31.466474 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7bc7d13f-3024-41b6-83bd-8becd1bd9ad2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:31.472915 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7bc7d13f-3024-41b6-83bd-8becd1bd9ad2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:31.473879 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7bc7d13f-3024-41b6-83bd-8becd1bd9ad2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:31.474645 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7bc7d13f-3024-41b6-83bd-8becd1bd9ad2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:31.475085 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7bc7d13f-3024-41b6-83bd-8becd1bd9ad2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:31.606928 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6058fa94-83c3-439d-bfc0-4071174491cc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:31.614863 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6058fa94-83c3-439d-bfc0-4071174491cc tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.209445 Jun 08 13:50:31.615951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 233/458] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:31 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:31.636329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7bc7d13f-3024-41b6-83bd-8becd1bd9ad2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:31.644272 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7bc7d13f-3024-41b6-83bd-8becd1bd9ad2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1722 microversion: 2.1 time: 0.182570 Jun 08 13:50:31.644831 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 226/459] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:31 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:32.002595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ae8b2844-5429-4df8-ad14-60d7fda3ef0e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:32.003201 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ae8b2844-5429-4df8-ad14-60d7fda3ef0e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:32.010376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ae8b2844-5429-4df8-ad14-60d7fda3ef0e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:32.010817 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ae8b2844-5429-4df8-ad14-60d7fda3ef0e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:32.011572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ae8b2844-5429-4df8-ad14-60d7fda3ef0e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:32.012004 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ae8b2844-5429-4df8-ad14-60d7fda3ef0e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:32.143062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ae8b2844-5429-4df8-ad14-60d7fda3ef0e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:32.150986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ae8b2844-5429-4df8-ad14-60d7fda3ef0e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1666 microversion: 2.1 time: 0.152267 Jun 08 13:50:32.151547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 234/460] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:31 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:32.631109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-33a4ec92-f4ca-42f4-8c99-98fe027f6948 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:32.631701 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-33a4ec92-f4ca-42f4-8c99-98fe027f6948 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:32.638236 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-33a4ec92-f4ca-42f4-8c99-98fe027f6948 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:32.638680 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-33a4ec92-f4ca-42f4-8c99-98fe027f6948 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:32.639438 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-33a4ec92-f4ca-42f4-8c99-98fe027f6948 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:32.639899 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-33a4ec92-f4ca-42f4-8c99-98fe027f6948 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:32.662523 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5ff5f546-e407-4d35-8d3e-f3035a5a5fa7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:32.663132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5ff5f546-e407-4d35-8d3e-f3035a5a5fa7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:32.669094 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5ff5f546-e407-4d35-8d3e-f3035a5a5fa7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:32.669546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5ff5f546-e407-4d35-8d3e-f3035a5a5fa7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:32.670310 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5ff5f546-e407-4d35-8d3e-f3035a5a5fa7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:32.670745 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5ff5f546-e407-4d35-8d3e-f3035a5a5fa7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:32.835116 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-33a4ec92-f4ca-42f4-8c99-98fe027f6948 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:32.839052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5ff5f546-e407-4d35-8d3e-f3035a5a5fa7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:32.842745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-33a4ec92-f4ca-42f4-8c99-98fe027f6948 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.216113 Jun 08 13:50:32.843325 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 227/461] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:32 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:32.847110 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5ff5f546-e407-4d35-8d3e-f3035a5a5fa7 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1722 microversion: 2.1 time: 0.188974 Jun 08 13:50:32.847663 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 235/462] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:32 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:33.860574 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3373d31b-288b-4c19-beb2-f4d51664f5ca tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:33.861194 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3373d31b-288b-4c19-beb2-f4d51664f5ca tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:33.865077 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1c12a390-b304-405f-b906-325b5955df2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:33.865701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1c12a390-b304-405f-b906-325b5955df2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:33.868269 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3373d31b-288b-4c19-beb2-f4d51664f5ca tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:33.868743 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3373d31b-288b-4c19-beb2-f4d51664f5ca tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:33.869516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3373d31b-288b-4c19-beb2-f4d51664f5ca tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:33.869956 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3373d31b-288b-4c19-beb2-f4d51664f5ca tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:33.872719 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1c12a390-b304-405f-b906-325b5955df2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:33.873174 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1c12a390-b304-405f-b906-325b5955df2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:33.873942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1c12a390-b304-405f-b906-325b5955df2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:33.874386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1c12a390-b304-405f-b906-325b5955df2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:34.074051 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3373d31b-288b-4c19-beb2-f4d51664f5ca tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:34.077673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1c12a390-b304-405f-b906-325b5955df2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:34.081897 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3373d31b-288b-4c19-beb2-f4d51664f5ca tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.225244 Jun 08 13:50:34.083203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 228/463] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:33 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:34.090067 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1c12a390-b304-405f-b906-325b5955df2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1722 microversion: 2.1 time: 0.225603 Jun 08 13:50:34.090067 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 236/464] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:33 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:35.101735 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-13afb8dd-3d3a-434f-9211-5d1ca7273bff tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:35.102366 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-13afb8dd-3d3a-434f-9211-5d1ca7273bff tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:35.103544 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-286c18e1-cdf1-438f-b05e-bbcaa0035846 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:35.104208 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-286c18e1-cdf1-438f-b05e-bbcaa0035846 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:35.110185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-13afb8dd-3d3a-434f-9211-5d1ca7273bff tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:35.111865 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-13afb8dd-3d3a-434f-9211-5d1ca7273bff tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:35.112119 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-13afb8dd-3d3a-434f-9211-5d1ca7273bff tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:35.112959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-13afb8dd-3d3a-434f-9211-5d1ca7273bff tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:35.114586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-286c18e1-cdf1-438f-b05e-bbcaa0035846 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:35.115281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-286c18e1-cdf1-438f-b05e-bbcaa0035846 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:35.116204 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-286c18e1-cdf1-438f-b05e-bbcaa0035846 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:35.116665 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-286c18e1-cdf1-438f-b05e-bbcaa0035846 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:35.314743 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-286c18e1-cdf1-438f-b05e-bbcaa0035846 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:35.322121 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-13afb8dd-3d3a-434f-9211-5d1ca7273bff tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:35.323838 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-286c18e1-cdf1-438f-b05e-bbcaa0035846 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1722 microversion: 2.1 time: 0.224181 Jun 08 13:50:35.324665 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 237/465] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:35 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:35.330366 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-13afb8dd-3d3a-434f-9211-5d1ca7273bff tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.235373 Jun 08 13:50:35.340174 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 229/466] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:35 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:36.342330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e1e5b78b-a392-4bde-88a7-66378ac3988a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:36.342951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e1e5b78b-a392-4bde-88a7-66378ac3988a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:36.347975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a6b44fb3-a41c-4cf1-a74c-1a3f71c41ad0 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:36.349125 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a6b44fb3-a41c-4cf1-a74c-1a3f71c41ad0 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:36.350033 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1e5b78b-a392-4bde-88a7-66378ac3988a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:36.350509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1e5b78b-a392-4bde-88a7-66378ac3988a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:36.351277 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1e5b78b-a392-4bde-88a7-66378ac3988a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:36.351715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1e5b78b-a392-4bde-88a7-66378ac3988a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:36.355320 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a6b44fb3-a41c-4cf1-a74c-1a3f71c41ad0 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:36.355778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a6b44fb3-a41c-4cf1-a74c-1a3f71c41ad0 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:36.356588 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a6b44fb3-a41c-4cf1-a74c-1a3f71c41ad0 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:36.357029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a6b44fb3-a41c-4cf1-a74c-1a3f71c41ad0 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:36.553459 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e1e5b78b-a392-4bde-88a7-66378ac3988a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:36.560346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a6b44fb3-a41c-4cf1-a74c-1a3f71c41ad0 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:36.561677 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e1e5b78b-a392-4bde-88a7-66378ac3988a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1722 microversion: 2.1 time: 0.223158 Jun 08 13:50:36.562276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 238/467] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:36 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:36.569233 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a6b44fb3-a41c-4cf1-a74c-1a3f71c41ad0 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.225378 Jun 08 13:50:36.573028 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 230/468] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:36 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:37.580061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-db335a37-7e87-4d8b-8445-cca8c47baae2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:37.580707 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-db335a37-7e87-4d8b-8445-cca8c47baae2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:37.586585 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e2d0179f-a3b4-4c9a-96f3-9c21df67b702 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:37.587207 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e2d0179f-a3b4-4c9a-96f3-9c21df67b702 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:37.587475 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db335a37-7e87-4d8b-8445-cca8c47baae2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:37.587926 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db335a37-7e87-4d8b-8445-cca8c47baae2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:37.588784 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db335a37-7e87-4d8b-8445-cca8c47baae2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:37.589222 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db335a37-7e87-4d8b-8445-cca8c47baae2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:37.593853 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e2d0179f-a3b4-4c9a-96f3-9c21df67b702 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:37.594238 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e2d0179f-a3b4-4c9a-96f3-9c21df67b702 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:37.595000 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e2d0179f-a3b4-4c9a-96f3-9c21df67b702 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:37.595430 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e2d0179f-a3b4-4c9a-96f3-9c21df67b702 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:37.787133 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-db335a37-7e87-4d8b-8445-cca8c47baae2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:37.790932 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e2d0179f-a3b4-4c9a-96f3-9c21df67b702 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:37.796017 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-db335a37-7e87-4d8b-8445-cca8c47baae2 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1722 microversion: 2.1 time: 0.219136 Jun 08 13:50:37.796017 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 239/469] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:37 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:37.798589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e2d0179f-a3b4-4c9a-96f3-9c21df67b702 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.215868 Jun 08 13:50:37.799146 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 231/470] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:37 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:38.813090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a10db35d-5634-4070-9164-4a8a6ef8299f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:38.813770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a10db35d-5634-4070-9164-4a8a6ef8299f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:38.815104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ae883379-d918-4168-abdc-471a94e888a7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:38.815724 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ae883379-d918-4168-abdc-471a94e888a7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:38.821380 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a10db35d-5634-4070-9164-4a8a6ef8299f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:38.821843 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a10db35d-5634-4070-9164-4a8a6ef8299f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:38.822657 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a10db35d-5634-4070-9164-4a8a6ef8299f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:38.823103 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a10db35d-5634-4070-9164-4a8a6ef8299f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:38.823203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ae883379-d918-4168-abdc-471a94e888a7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:38.823626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ae883379-d918-4168-abdc-471a94e888a7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:38.824422 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ae883379-d918-4168-abdc-471a94e888a7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:38.824861 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ae883379-d918-4168-abdc-471a94e888a7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:39.015851 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a10db35d-5634-4070-9164-4a8a6ef8299f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:39.023098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ae883379-d918-4168-abdc-471a94e888a7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:39.025055 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a10db35d-5634-4070-9164-4a8a6ef8299f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1722 microversion: 2.1 time: 0.215829 Jun 08 13:50:39.025637 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 240/471] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:38 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:39.030429 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ae883379-d918-4168-abdc-471a94e888a7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.219116 Jun 08 13:50:39.030977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 232/472] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:38 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:40.042191 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-37a484e3-fc19-4e84-a3a7-dc5c06e63bf8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:40.042813 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-37a484e3-fc19-4e84-a3a7-dc5c06e63bf8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:40.046636 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5b00373c-13ef-44b5-8eea-2bb7821eaa6f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:40.047246 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5b00373c-13ef-44b5-8eea-2bb7821eaa6f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:40.049496 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37a484e3-fc19-4e84-a3a7-dc5c06e63bf8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:40.049947 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37a484e3-fc19-4e84-a3a7-dc5c06e63bf8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:40.050759 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37a484e3-fc19-4e84-a3a7-dc5c06e63bf8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:40.051391 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-37a484e3-fc19-4e84-a3a7-dc5c06e63bf8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:40.053893 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5b00373c-13ef-44b5-8eea-2bb7821eaa6f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:40.054349 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5b00373c-13ef-44b5-8eea-2bb7821eaa6f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:40.055117 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5b00373c-13ef-44b5-8eea-2bb7821eaa6f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:40.055561 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5b00373c-13ef-44b5-8eea-2bb7821eaa6f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:40.241141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-37a484e3-fc19-4e84-a3a7-dc5c06e63bf8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:40.254536 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5b00373c-13ef-44b5-8eea-2bb7821eaa6f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:40.254738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-37a484e3-fc19-4e84-a3a7-dc5c06e63bf8 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1722 microversion: 2.1 time: 0.214005 Jun 08 13:50:40.254738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 241/473] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:40 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:40.262200 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5b00373c-13ef-44b5-8eea-2bb7821eaa6f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.219248 Jun 08 13:50:40.262768 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 233/474] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:40 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:40.651611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-e6b17ebb-3d3a-4217-88d9-e3874187c5b4 req-effde67a-9b90-4391-99ac-f41bddb48351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ed7b73-7978-4c81-84f1-53d223ad842f", "name": "network-vif-plugged", "status": "completed", "tag": "86e5c27b-3254-42aa-9d0f-5a43c944241b"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:40.663427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e6b17ebb-3d3a-4217-88d9-e3874187c5b4 req-effde67a-9b90-4391-99ac-f41bddb48351 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:40.663427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e6b17ebb-3d3a-4217-88d9-e3874187c5b4 req-effde67a-9b90-4391-99ac-f41bddb48351 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:40.671322 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-e6b17ebb-3d3a-4217-88d9-e3874187c5b4 req-effde67a-9b90-4391-99ac-f41bddb48351 service nova] Creating event network-vif-plugged:86e5c27b-3254-42aa-9d0f-5a43c944241b for instance 08ed7b73-7978-4c81-84f1-53d223ad842f on hv-cinder-81914 Jun 08 13:50:40.676967 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-e6b17ebb-3d3a-4217-88d9-e3874187c5b4 req-effde67a-9b90-4391-99ac-f41bddb48351 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029706 Jun 08 13:50:40.677533 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 242/475] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:50:41.270781 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-df66297d-3e0f-449c-852d-a6760c096fa4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:41.271496 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-df66297d-3e0f-449c-852d-a6760c096fa4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:41.278809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df66297d-3e0f-449c-852d-a6760c096fa4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:41.279335 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df66297d-3e0f-449c-852d-a6760c096fa4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:41.280331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df66297d-3e0f-449c-852d-a6760c096fa4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:41.280770 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df66297d-3e0f-449c-852d-a6760c096fa4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:41.282146 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fea81c12-4e86-47ff-a58b-7df46fa5f554 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:41.282883 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fea81c12-4e86-47ff-a58b-7df46fa5f554 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:41.290430 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fea81c12-4e86-47ff-a58b-7df46fa5f554 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:41.291224 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fea81c12-4e86-47ff-a58b-7df46fa5f554 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:41.292018 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fea81c12-4e86-47ff-a58b-7df46fa5f554 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:41.292525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fea81c12-4e86-47ff-a58b-7df46fa5f554 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:41.485355 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-df66297d-3e0f-449c-852d-a6760c096fa4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:41.494167 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-df66297d-3e0f-449c-852d-a6760c096fa4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1722 microversion: 2.1 time: 0.227314 Jun 08 13:50:41.494783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 234/476] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:41 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:41.514249 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-fea81c12-4e86-47ff-a58b-7df46fa5f554 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:41.523743 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fea81c12-4e86-47ff-a58b-7df46fa5f554 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.246663 Jun 08 13:50:41.524358 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 243/477] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:41 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:42.511053 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4f58de64-c60f-430e-aff0-d1b49aa23a49 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:42.511594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4f58de64-c60f-430e-aff0-d1b49aa23a49 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:42.517967 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4f58de64-c60f-430e-aff0-d1b49aa23a49 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:42.518411 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4f58de64-c60f-430e-aff0-d1b49aa23a49 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:42.519162 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4f58de64-c60f-430e-aff0-d1b49aa23a49 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:42.520407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4f58de64-c60f-430e-aff0-d1b49aa23a49 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:42.540502 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-578a6b51-f5b3-4ea2-853d-3f26aa9adf02 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:42.541120 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-578a6b51-f5b3-4ea2-853d-3f26aa9adf02 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:42.547576 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-578a6b51-f5b3-4ea2-853d-3f26aa9adf02 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:42.548027 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-578a6b51-f5b3-4ea2-853d-3f26aa9adf02 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:42.548830 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-578a6b51-f5b3-4ea2-853d-3f26aa9adf02 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:42.549274 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-578a6b51-f5b3-4ea2-853d-3f26aa9adf02 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:42.701878 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4f58de64-c60f-430e-aff0-d1b49aa23a49 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:42.710653 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4f58de64-c60f-430e-aff0-d1b49aa23a49 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1728 microversion: 2.1 time: 0.203485 Jun 08 13:50:42.713368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 235/478] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:42 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:42.731013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-beb5337c-ce25-42bf-a5a0-7e9e16c88b0d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:42.731013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-beb5337c-ce25-42bf-a5a0-7e9e16c88b0d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:42.731210 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-578a6b51-f5b3-4ea2-853d-3f26aa9adf02 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:42.735539 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-beb5337c-ce25-42bf-a5a0-7e9e16c88b0d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:42.736314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-beb5337c-ce25-42bf-a5a0-7e9e16c88b0d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:42.737304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-beb5337c-ce25-42bf-a5a0-7e9e16c88b0d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:42.737829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-578a6b51-f5b3-4ea2-853d-3f26aa9adf02 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.201198 Jun 08 13:50:42.737948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-beb5337c-ce25-42bf-a5a0-7e9e16c88b0d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:42.738425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 244/479] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:42 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:42.747444 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f3d931a0-fbf8-4b42-be36-55f902b43501 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:42.747988 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f3d931a0-fbf8-4b42-be36-55f902b43501 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:42.749981 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:42.755257 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3d931a0-fbf8-4b42-be36-55f902b43501 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:42.755702 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3d931a0-fbf8-4b42-be36-55f902b43501 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:42.756494 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3d931a0-fbf8-4b42-be36-55f902b43501 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:42.756932 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3d931a0-fbf8-4b42-be36-55f902b43501 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:42.828178 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-beb5337c-ce25-42bf-a5a0-7e9e16c88b0d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101867 Jun 08 13:50:42.828178 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 236/480] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 8 13:50:42 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:50:42.834851 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=100 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:42.840201 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-f3d931a0-fbf8-4b42-be36-55f902b43501 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lazy-loading 'services' on Instance uuid 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:50:43.031217 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f3d931a0-fbf8-4b42-be36-55f902b43501 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb/os-volume_attachments/b2d9f939-9be8-491e-b493-2a38adf0d9f0" status: 202 len: 0 microversion: 2.1 time: 0.287426 Jun 08 13:50:43.034817 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 245/481] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:50:42 2022] DELETE /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb/os-volume_attachments/b2d9f939-9be8-491e-b493-2a38adf0d9f0 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 13:50:43.755081 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6b8ea443-f21b-467a-9903-6568d6d462ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:43.755628 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6b8ea443-f21b-467a-9903-6568d6d462ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:43.761693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6b8ea443-f21b-467a-9903-6568d6d462ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:43.762143 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6b8ea443-f21b-467a-9903-6568d6d462ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:43.763176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6b8ea443-f21b-467a-9903-6568d6d462ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:43.763366 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6b8ea443-f21b-467a-9903-6568d6d462ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:43.954860 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6b8ea443-f21b-467a-9903-6568d6d462ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:43.962818 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6b8ea443-f21b-467a-9903-6568d6d462ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1358 microversion: 2.1 time: 0.212876 Jun 08 13:50:43.963404 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 237/482] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:43 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:44.064561 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-c3039576-d8e3-4fbb-8989-32bc2997dbb5 req-8884180e-ffb0-477e-903d-93c1b39cc931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777c65ea-2412-4080-9c2c-ee5201184c1e", "tag": "d1b9ce5f-7ee5-4967-93f0-2a76e3005b21"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:44.074340 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-c3039576-d8e3-4fbb-8989-32bc2997dbb5 req-8884180e-ffb0-477e-903d-93c1b39cc931 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:44.074794 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-c3039576-d8e3-4fbb-8989-32bc2997dbb5 req-8884180e-ffb0-477e-903d-93c1b39cc931 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:44.104706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-c3039576-d8e3-4fbb-8989-32bc2997dbb5 req-8884180e-ffb0-477e-903d-93c1b39cc931 service nova] Creating event network-changed:d1b9ce5f-7ee5-4967-93f0-2a76e3005b21 for instance 777c65ea-2412-4080-9c2c-ee5201184c1e on hv-cinder-81914 Jun 08 13:50:44.111750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-c3039576-d8e3-4fbb-8989-32bc2997dbb5 req-8884180e-ffb0-477e-903d-93c1b39cc931 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052712 Jun 08 13:50:44.112620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 246/483] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:50:44.979308 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5a9e530d-2e4c-4fa8-be9b-cce50b8bf9bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:44.980634 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5a9e530d-2e4c-4fa8-be9b-cce50b8bf9bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:44.987860 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a9e530d-2e4c-4fa8-be9b-cce50b8bf9bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:44.988819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a9e530d-2e4c-4fa8-be9b-cce50b8bf9bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:44.989646 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a9e530d-2e4c-4fa8-be9b-cce50b8bf9bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:44.990088 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a9e530d-2e4c-4fa8-be9b-cce50b8bf9bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.125239 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5a9e530d-2e4c-4fa8-be9b-cce50b8bf9bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:45.132923 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5a9e530d-2e4c-4fa8-be9b-cce50b8bf9bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1548 microversion: 2.1 time: 0.157888 Jun 08 13:50:45.133486 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 238/484] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:44 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:45.150777 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d9fb77c6-2dbd-4839-a822-34505995b4df tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:45.151625 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d9fb77c6-2dbd-4839-a822-34505995b4df tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:45.196081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d9fb77c6-2dbd-4839-a822-34505995b4df tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.196081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d9fb77c6-2dbd-4839-a822-34505995b4df tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.196081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d9fb77c6-2dbd-4839-a822-34505995b4df tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.196081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d9fb77c6-2dbd-4839-a822-34505995b4df tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.210100 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b936f27b-c57f-42b6-b0e5-474fed58262b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:45.210591 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b936f27b-c57f-42b6-b0e5-474fed58262b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:45.216419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b936f27b-c57f-42b6-b0e5-474fed58262b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.216870 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b936f27b-c57f-42b6-b0e5-474fed58262b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.217626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b936f27b-c57f-42b6-b0e5-474fed58262b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.218058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b936f27b-c57f-42b6-b0e5-474fed58262b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.223063 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:45.243693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b936f27b-c57f-42b6-b0e5-474fed58262b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Going to try to terminate instance {{(pid=124628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:50:45.298677 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d9fb77c6-2dbd-4839-a822-34505995b4df tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:45.306320 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d9fb77c6-2dbd-4839-a822-34505995b4df tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1548 microversion: 2.1 time: 0.159742 Jun 08 13:50:45.308076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 247/485] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:45 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:45.321839 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-87b6de21-045f-4457-b48b-abcd692e40f1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:45.325273 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-87b6de21-045f-4457-b48b-abcd692e40f1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:45.326031 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-87b6de21-045f-4457-b48b-abcd692e40f1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Searching by: {'deleted': False, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69'} {{(pid=124629) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 08 13:50:45.333291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-87b6de21-045f-4457-b48b-abcd692e40f1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.333747 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-87b6de21-045f-4457-b48b-abcd692e40f1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.334553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-87b6de21-045f-4457-b48b-abcd692e40f1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.334997 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-87b6de21-045f-4457-b48b-abcd692e40f1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.429830 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.multi_cell_list [None req-87b6de21-045f-4457-b48b-abcd692e40f1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124629) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 08 13:50:45.529696 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-87b6de21-045f-4457-b48b-abcd692e40f1 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211277 Jun 08 13:50:45.530289 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 248/486] 10.222.0.55 () {58 vars in 1124 bytes} [Wed Jun 8 13:50:45 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:50:45.540509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-97bb54a7-1f67-4b6e-97f6-8a53d927bff7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:45.541117 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-97bb54a7-1f67-4b6e-97f6-8a53d927bff7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:45.552738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97bb54a7-1f67-4b6e-97f6-8a53d927bff7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.552738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97bb54a7-1f67-4b6e-97f6-8a53d927bff7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.552738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97bb54a7-1f67-4b6e-97f6-8a53d927bff7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.552738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97bb54a7-1f67-4b6e-97f6-8a53d927bff7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.620876 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b936f27b-c57f-42b6-b0e5-474fed58262b tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 204 len: 0 microversion: 2.1 time: 0.414729 Jun 08 13:50:45.621477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 239/487] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:50:45 2022] DELETE /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 08 13:50:45.630700 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-045fc0bc-55bd-4267-a1d1-5a1124d10260 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:45.631419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-045fc0bc-55bd-4267-a1d1-5a1124d10260 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:45.633371 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:45.638209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-045fc0bc-55bd-4267-a1d1-5a1124d10260 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.645083 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-045fc0bc-55bd-4267-a1d1-5a1124d10260 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.645083 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-045fc0bc-55bd-4267-a1d1-5a1124d10260 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:45.645083 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-045fc0bc-55bd-4267-a1d1-5a1124d10260 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:45.679779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-97bb54a7-1f67-4b6e-97f6-8a53d927bff7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:45.687372 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-97bb54a7-1f67-4b6e-97f6-8a53d927bff7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1548 microversion: 2.1 time: 0.150476 Jun 08 13:50:45.687953 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 249/488] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:45 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:45.781560 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-045fc0bc-55bd-4267-a1d1-5a1124d10260 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:45.789586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-045fc0bc-55bd-4267-a1d1-5a1124d10260 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1515 microversion: 2.1 time: 0.163881 Jun 08 13:50:45.790150 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 240/489] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:45 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:46.126750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-82b59c54-435f-4ba0-97bd-50fcd84e4750 req-63d42357-2ac2-4a42-986e-25c91533a9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777c65ea-2412-4080-9c2c-ee5201184c1e", "tag": "d1b9ce5f-7ee5-4967-93f0-2a76e3005b21"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:46.134725 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-82b59c54-435f-4ba0-97bd-50fcd84e4750 req-63d42357-2ac2-4a42-986e-25c91533a9c1 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:46.135169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-82b59c54-435f-4ba0-97bd-50fcd84e4750 req-63d42357-2ac2-4a42-986e-25c91533a9c1 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:46.146336 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-82b59c54-435f-4ba0-97bd-50fcd84e4750 req-63d42357-2ac2-4a42-986e-25c91533a9c1 service nova] Creating event network-changed:d1b9ce5f-7ee5-4967-93f0-2a76e3005b21 for instance 777c65ea-2412-4080-9c2c-ee5201184c1e on hv-cinder-81914 Jun 08 13:50:46.151798 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-82b59c54-435f-4ba0-97bd-50fcd84e4750 req-63d42357-2ac2-4a42-986e-25c91533a9c1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028654 Jun 08 13:50:46.156176 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 250/490] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:50:46.807384 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-da740e35-00cb-43b1-a147-e52f1ace2566 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:46.807919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-da740e35-00cb-43b1-a147-e52f1ace2566 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:46.814444 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-da740e35-00cb-43b1-a147-e52f1ace2566 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:46.814898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-da740e35-00cb-43b1-a147-e52f1ace2566 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:46.815660 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-da740e35-00cb-43b1-a147-e52f1ace2566 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:46.816903 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-da740e35-00cb-43b1-a147-e52f1ace2566 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:46.942248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-da740e35-00cb-43b1-a147-e52f1ace2566 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:46.949743 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-da740e35-00cb-43b1-a147-e52f1ace2566 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1515 microversion: 2.1 time: 0.146413 Jun 08 13:50:46.950313 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 241/491] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:46 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:47.690219 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a66899cc-5894-467f-9b59-5ed28232c2a2 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57465250-b54f-4f7c-9b22-6bd074a0dab1"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:47.691895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a66899cc-5894-467f-9b59-5ed28232c2a2 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:47.698520 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a66899cc-5894-467f-9b59-5ed28232c2a2 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:47.698895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a66899cc-5894-467f-9b59-5ed28232c2a2 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:47.699661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a66899cc-5894-467f-9b59-5ed28232c2a2 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:47.700258 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a66899cc-5894-467f-9b59-5ed28232c2a2 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:47.966586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-87ae80fa-0d71-4f8b-98c5-dc0e1db5418a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:47.967206 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-87ae80fa-0d71-4f8b-98c5-dc0e1db5418a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:47.974251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-87ae80fa-0d71-4f8b-98c5-dc0e1db5418a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:47.974703 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-87ae80fa-0d71-4f8b-98c5-dc0e1db5418a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:47.975473 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-87ae80fa-0d71-4f8b-98c5-dc0e1db5418a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:47.975912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-87ae80fa-0d71-4f8b-98c5-dc0e1db5418a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:48.117267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-87ae80fa-0d71-4f8b-98c5-dc0e1db5418a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:48.124966 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-87ae80fa-0d71-4f8b-98c5-dc0e1db5418a tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1515 microversion: 2.1 time: 0.162675 Jun 08 13:50:48.125618 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 242/492] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:47 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:50:48.333028 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-3933766b-5e23-48c5-9ca2-3999cfc07987 req-07f888d8-33f8-4987-b9a5-063e4decdb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5333f0-e2b2-4fae-9392-8dedd5bee5cb", "name": "network-vif-deleted", "tag": "54564d2a-ca9f-4f1a-998d-b332f1702e71"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:48.341027 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-3933766b-5e23-48c5-9ca2-3999cfc07987 req-07f888d8-33f8-4987-b9a5-063e4decdb8b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:48.341502 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-3933766b-5e23-48c5-9ca2-3999cfc07987 req-07f888d8-33f8-4987-b9a5-063e4decdb8b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:48.353246 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-3933766b-5e23-48c5-9ca2-3999cfc07987 req-07f888d8-33f8-4987-b9a5-063e4decdb8b service nova] Creating event network-vif-deleted:54564d2a-ca9f-4f1a-998d-b332f1702e71 for instance 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb on hv-cinder-81914 Jun 08 13:50:48.357985 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-3933766b-5e23-48c5-9ca2-3999cfc07987 req-07f888d8-33f8-4987-b9a5-063e4decdb8b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029383 Jun 08 13:50:48.358572 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 243/493] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:50:48.502612 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a66899cc-5894-467f-9b59-5ed28232c2a2 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "POST /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817270 Jun 08 13:50:48.503148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 251/494] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:50:47 2022] POST /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:50:49.143185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:49.143922 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:49.150608 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:49.151105 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:49.151889 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:49.152360 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:49.184724 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:49.185184 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:49.185682 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lazy-loading 'fault' on Instance uuid 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:50:49.230754 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d78d4ead234cc68e377c8b5b6e4d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b38f30ffdc74b66aa2a5ed7d7eb1e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:49.239174 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-66fb022c-109e-4295-8711-05093f6eb196 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 200 len: 1309 microversion: 2.1 time: 0.100760 Jun 08 13:50:49.239735 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 244/495] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:49 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:50.258161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:50.258867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] [instance: 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:50.265306 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:50.265877 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:50.266556 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:50.266997 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:50.281301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] HTTP exception thrown: Instance 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb could not be found. Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Request method failure captured: Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb HTTP/1.1 Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKiPz_c6p9HR1UbnMcRnBEtn4Jk1QxZ3VdY0ExUvVTuXYc8wXlWi_0mgCTNApuW8_2TCl7PBnpqnXwjBgXrxzmdC_Y7_WPxeXL4wrzpISEJmc2iQobEspNzIwFcGI2QQNTj9RhYBg9-JkV8LUzJrlb86KhEe93kqNi1XQ18L7DV1vQY Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 1b38f30ffdc74b66aa2a5ed7d7eb1e0d Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2052363107 Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:50:50.285562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1b38f30ffdc74b66aa2a5ed7d7eb1e0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_1b38f30ffdc74b66aa2a5ed7d7eb1e0d", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/1b38f30ffdc74b66aa2a5ed7d7eb1e0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/1b38f30ffdc74b66aa2a5ed7d7eb1e0d"}]}] Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-VolumesSnapshotTestJSON-2052363107 Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 1b38f30ffdc74b66aa2a5ed7d7eb1e0d Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2052363107 Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-VolumesSnapshotTestJSON-2052363107-project Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 28d78d4ead234cc68e377c8b5b6e4d5a Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-VolumesSnapshotTestJSON-2052363107-project Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb could not be found. Jun 08 13:50:50.287156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '5f5333f0-e2b2-4fae-9392-8dedd5bee5cb'} Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb could not be found. Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:50:50.288039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb could not be found. Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb could not be found. Jun 08 13:50:50.289554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:50:50.291264 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] Returning 404 to user: Instance 5f5333f0-e2b2-4fae-9392-8dedd5bee5cb could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:50:50.291264 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4bc78d38-7f2b-42fe-9e2b-424c518ae800 tempest-VolumesSnapshotTestJSON-2052363107 tempest-VolumesSnapshotTestJSON-2052363107-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb" status: 404 len: 111 microversion: 2.1 time: 0.031649 Jun 08 13:50:50.291264 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 252/496] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:50 2022] GET /compute/v2.1/servers/5f5333f0-e2b2-4fae-9392-8dedd5bee5cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:50:55.793662 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-52912b4b-7fac-47e1-8c7c-d3bafb4a25b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:55.794220 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-52912b4b-7fac-47e1-8c7c-d3bafb4a25b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:55.801625 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-52912b4b-7fac-47e1-8c7c-d3bafb4a25b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:55.802076 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-52912b4b-7fac-47e1-8c7c-d3bafb4a25b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:55.802854 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-52912b4b-7fac-47e1-8c7c-d3bafb4a25b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:55.803300 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-52912b4b-7fac-47e1-8c7c-d3bafb4a25b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:55.832700 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-52912b4b-7fac-47e1-8c7c-d3bafb4a25b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments/69e6bd74-3ce6-4e16-ac4c-aa8f491750a8" status: 200 len: 194 microversion: 2.20 time: 0.043140 Jun 08 13:50:55.833287 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 245/497] 10.222.0.55 () {60 vars in 1453 bytes} [Wed Jun 8 13:50:55 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments/69e6bd74-3ce6-4e16-ac4c-aa8f491750a8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:50:55.894941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a3627ee3-3fb2-4b53-bbc8-b08b0b0dff5d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:55.895442 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a3627ee3-3fb2-4b53-bbc8-b08b0b0dff5d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:55.898908 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:50:55.902461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a3627ee3-3fb2-4b53-bbc8-b08b0b0dff5d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:55.902902 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a3627ee3-3fb2-4b53-bbc8-b08b0b0dff5d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:55.903664 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a3627ee3-3fb2-4b53-bbc8-b08b0b0dff5d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:55.904120 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a3627ee3-3fb2-4b53-bbc8-b08b0b0dff5d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:55.988194 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-a3627ee3-3fb2-4b53-bbc8-b08b0b0dff5d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lazy-loading 'services' on Instance uuid ac779098-8aa5-40b8-ae7d-dc4e463f015b {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:50:56.208991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a3627ee3-3fb2-4b53-bbc8-b08b0b0dff5d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments/69e6bd74-3ce6-4e16-ac4c-aa8f491750a8" status: 202 len: 0 microversion: 2.20 time: 0.317658 Jun 08 13:50:56.209624 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 253/498] 10.222.0.55 () {60 vars in 1456 bytes} [Wed Jun 8 13:50:55 2022] DELETE /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments/69e6bd74-3ce6-4e16-ac4c-aa8f491750a8 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:50:56.218700 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-45ef24ea-d49e-4517-ad43-c7046d689c31 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:56.219626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-45ef24ea-d49e-4517-ad43-c7046d689c31 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:56.225981 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45ef24ea-d49e-4517-ad43-c7046d689c31 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:56.226481 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45ef24ea-d49e-4517-ad43-c7046d689c31 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:56.232170 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45ef24ea-d49e-4517-ad43-c7046d689c31 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:56.232170 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45ef24ea-d49e-4517-ad43-c7046d689c31 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:56.256925 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-45ef24ea-d49e-4517-ad43-c7046d689c31 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042434 Jun 08 13:50:56.257482 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 246/499] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 8 13:50:56 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:50:57.116719 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-225e3795-350e-400b-b21c-a95b52c6773c tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:57.117424 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-225e3795-350e-400b-b21c-a95b52c6773c tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:57.124331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-225e3795-350e-400b-b21c-a95b52c6773c tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:57.124784 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-225e3795-350e-400b-b21c-a95b52c6773c tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:57.125551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-225e3795-350e-400b-b21c-a95b52c6773c tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:57.125991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-225e3795-350e-400b-b21c-a95b52c6773c tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:57.261872 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-225e3795-350e-400b-b21c-a95b52c6773c tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:57.269310 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6bbdbdf3-4323-4cd2-82cf-2d507da8bace tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:57.270192 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-225e3795-350e-400b-b21c-a95b52c6773c tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1594 microversion: 2.1 time: 0.158124 Jun 08 13:50:57.270342 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6bbdbdf3-4323-4cd2-82cf-2d507da8bace tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:57.270767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 254/500] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:50:57 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:57.277215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6bbdbdf3-4323-4cd2-82cf-2d507da8bace tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:57.277670 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6bbdbdf3-4323-4cd2-82cf-2d507da8bace tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:57.278461 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6bbdbdf3-4323-4cd2-82cf-2d507da8bace tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:57.278891 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6bbdbdf3-4323-4cd2-82cf-2d507da8bace tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:57.310160 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6bbdbdf3-4323-4cd2-82cf-2d507da8bace tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045076 Jun 08 13:50:57.310732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 247/501] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 8 13:50:57 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:50:58.322553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ffb0d3f2-1ed7-41df-802a-f351dce78670 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:58.323551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ffb0d3f2-1ed7-41df-802a-f351dce78670 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:58.330270 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3f2-1ed7-41df-802a-f351dce78670 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:58.330722 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3f2-1ed7-41df-802a-f351dce78670 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:58.332088 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3f2-1ed7-41df-802a-f351dce78670 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:58.332532 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ffb0d3f2-1ed7-41df-802a-f351dce78670 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:58.362059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ffb0d3f2-1ed7-41df-802a-f351dce78670 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043443 Jun 08 13:50:58.362633 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 255/502] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 8 13:50:58 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:50:58.421255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6f165597-39ba-4b79-9cb3-adeb3098e821 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:58.421710 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6f165597-39ba-4b79-9cb3-adeb3098e821 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:58.428442 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f165597-39ba-4b79-9cb3-adeb3098e821 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:58.428900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f165597-39ba-4b79-9cb3-adeb3098e821 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:58.429660 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f165597-39ba-4b79-9cb3-adeb3098e821 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:58.430095 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6f165597-39ba-4b79-9cb3-adeb3098e821 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:58.457152 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6f165597-39ba-4b79-9cb3-adeb3098e821 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Going to try to terminate instance {{(pid=124628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:50:58.809024 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6f165597-39ba-4b79-9cb3-adeb3098e821 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 204 len: 0 microversion: 2.20 time: 0.391427 Jun 08 13:50:58.809822 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 248/503] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 8 13:50:58 2022] DELETE /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 08 13:50:58.817870 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:50:58.818666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:50:58.824727 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:58.825175 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:58.825940 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:58.826373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:59.051821 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:59.059991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:59.061628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:50:59.062812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-aaa9e76f-7d2c-4538-93de-0326f5710477 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.248729 Jun 08 13:50:59.063384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 256/504] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:50:58 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:50:59.497976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-3b82187e-a00c-4ead-8c62-357e5307d357 req-cee7a4d5-a48a-4fcc-9379-7fd99ce46347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ed7b73-7978-4c81-84f1-53d223ad842f", "tag": "86e5c27b-3254-42aa-9d0f-5a43c944241b"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:50:59.510497 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-3b82187e-a00c-4ead-8c62-357e5307d357 req-cee7a4d5-a48a-4fcc-9379-7fd99ce46347 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:50:59.511240 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-3b82187e-a00c-4ead-8c62-357e5307d357 req-cee7a4d5-a48a-4fcc-9379-7fd99ce46347 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:50:59.525227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-3b82187e-a00c-4ead-8c62-357e5307d357 req-cee7a4d5-a48a-4fcc-9379-7fd99ce46347 service nova] Creating event network-changed:86e5c27b-3254-42aa-9d0f-5a43c944241b for instance 08ed7b73-7978-4c81-84f1-53d223ad842f on hv-cinder-81914 Jun 08 13:50:59.530246 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-3b82187e-a00c-4ead-8c62-357e5307d357 req-cee7a4d5-a48a-4fcc-9379-7fd99ce46347 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036738 Jun 08 13:50:59.530969 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 249/505] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:00.082696 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:00.083436 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:00.093728 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:00.094452 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:00.095452 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:00.099352 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:00.239501 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:00.251144 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:00.253048 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:00.254423 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5261b61b-05c5-485c-b7a3-3f598d76dad6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.176277 Jun 08 13:51:00.255038 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 257/506] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:00 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:51:01.274605 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:01.275461 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:01.281657 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:01.282111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:01.282875 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:01.283313 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:01.435540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:01.445728 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:01.451161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:01.452377 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-374b0c0a-177e-4369-bb16-f057dba579dc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1720 microversion: 2.20 time: 0.182484 Jun 08 13:51:01.452987 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 250/507] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:01 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:02.095768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-0730f038-99b5-4d75-b9a8-ed60d488f14f req-0f055cd4-a051-4999-969e-58b68e3bfa62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac779098-8aa5-40b8-ae7d-dc4e463f015b", "name": "network-vif-deleted", "tag": "a0a7ddb0-7def-4156-9a5b-f3b477a1c311"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:02.108434 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-0730f038-99b5-4d75-b9a8-ed60d488f14f req-0f055cd4-a051-4999-969e-58b68e3bfa62 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:02.109429 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-0730f038-99b5-4d75-b9a8-ed60d488f14f req-0f055cd4-a051-4999-969e-58b68e3bfa62 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:02.122538 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-0730f038-99b5-4d75-b9a8-ed60d488f14f req-0f055cd4-a051-4999-969e-58b68e3bfa62 service nova] Creating event network-vif-deleted:a0a7ddb0-7def-4156-9a5b-f3b477a1c311 for instance ac779098-8aa5-40b8-ae7d-dc4e463f015b on hv-cinder-81914 Jun 08 13:51:02.128897 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-0730f038-99b5-4d75-b9a8-ed60d488f14f req-0f055cd4-a051-4999-969e-58b68e3bfa62 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042858 Jun 08 13:51:02.130071 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 258/508] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:02.473323 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:02.474572 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:02.481507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:02.482203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:02.482964 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:02.483661 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:02.726969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-04ea481e-32d5-41d9-8d54-4e3f90701c40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1841842695"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:02.728165 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-04ea481e-32d5-41d9-8d54-4e3f90701c40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:02.733992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-04ea481e-32d5-41d9-8d54-4e3f90701c40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:02.734434 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-04ea481e-32d5-41d9-8d54-4e3f90701c40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:02.735393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-04ea481e-32d5-41d9-8d54-4e3f90701c40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:02.735878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-04ea481e-32d5-41d9-8d54-4e3f90701c40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:02.782847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:02.796945 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:02.798574 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:02.800282 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b65e34d4-af2c-4296-8664-0a47fdda701b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1653 microversion: 2.20 time: 0.331550 Jun 08 13:51:02.801316 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 251/509] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:02 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1653 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:02.893924 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.network.security_group_api [None req-04ea481e-32d5-41d9-8d54-4e3f90701c40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Adding security group a312ba82-f39d-4542-8a23-2c668eaeafb4 to port 86e5c27b-3254-42aa-9d0f-5a43c944241b Jun 08 13:51:03.415116 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-04ea481e-32d5-41d9-8d54-4e3f90701c40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "POST /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/action" status: 202 len: 0 microversion: 2.1 time: 0.692516 Jun 08 13:51:03.422438 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 259/510] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:51:02 2022] POST /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 13:51:03.425477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-82157156-0c7e-4654-a9cf-50028e8a6715 req-1bfaf972-83e1-42ff-8c69-4927c6414614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ed7b73-7978-4c81-84f1-53d223ad842f", "tag": "86e5c27b-3254-42aa-9d0f-5a43c944241b"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:03.432458 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c6afa5fe-fa56-4ef1-9913-635cfcaf9a92 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:03.433480 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c6afa5fe-fa56-4ef1-9913-635cfcaf9a92 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:03.450613 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c6afa5fe-fa56-4ef1-9913-635cfcaf9a92 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:03.451773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c6afa5fe-fa56-4ef1-9913-635cfcaf9a92 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:03.453693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-82157156-0c7e-4654-a9cf-50028e8a6715 req-1bfaf972-83e1-42ff-8c69-4927c6414614 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:03.454155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-82157156-0c7e-4654-a9cf-50028e8a6715 req-1bfaf972-83e1-42ff-8c69-4927c6414614 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:03.465170 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c6afa5fe-fa56-4ef1-9913-635cfcaf9a92 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:03.467521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c6afa5fe-fa56-4ef1-9913-635cfcaf9a92 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:03.478609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-82157156-0c7e-4654-a9cf-50028e8a6715 req-1bfaf972-83e1-42ff-8c69-4927c6414614 service nova] Creating event network-changed:86e5c27b-3254-42aa-9d0f-5a43c944241b for instance 08ed7b73-7978-4c81-84f1-53d223ad842f on hv-cinder-81914 Jun 08 13:51:03.484205 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-82157156-0c7e-4654-a9cf-50028e8a6715 req-1bfaf972-83e1-42ff-8c69-4927c6414614 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062867 Jun 08 13:51:03.485169 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 252/511] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:03.665905 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c6afa5fe-fa56-4ef1-9913-635cfcaf9a92 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:03.674653 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c6afa5fe-fa56-4ef1-9913-635cfcaf9a92 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1760 microversion: 2.1 time: 0.250765 Jun 08 13:51:03.676133 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 260/512] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:03 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1760 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:03.821662 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:03.822483 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:03.834727 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:03.836501 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:03.838488 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:03.839028 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:03.914848 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:03.923050 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:03.925235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:03.926524 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2d5cb752-9c60-4a9d-84b1-00bc5aa38546 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1653 microversion: 2.20 time: 0.111498 Jun 08 13:51:03.927161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 253/513] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:03 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1653 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:04.945296 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:04.945988 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:04.952551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:04.953017 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:04.953911 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:04.954261 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:04.989906 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:04.990267 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:04.990728 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lazy-loading 'fault' on Instance uuid ac779098-8aa5-40b8-ae7d-dc4e463f015b {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:51:05.035466 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:05.043993 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:05.045598 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:05.046772 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-48f6486a-7310-4357-9241-e463f667112b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 200 len: 1371 microversion: 2.20 time: 0.105406 Jun 08 13:51:05.057576 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 261/514] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:04 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:06.065344 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:06.066063 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:06.072547 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:06.072990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:06.073756 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:06.074193 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:06.078275 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:06.088029 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] HTTP exception thrown: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Request method failure captured: Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b HTTP/1.1 Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKhOMg0sQ6j2KBIutHS3ZyoENBz50XCeNH8japzptI5VAh0odtZjvahg0bHSv5T7jRtkm5Oy4CWbLLc4prA7Lb5NH3f98jSFB6yarXxcLtxrUgGG_CGlvJqnXMQHW1reC2vJt5-wDjmqPCwsjuI0-VNfiwHAaQFBgnSjm0qfNdtOFHI Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:51:06.089672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0cc65fa99694daa81878db0200bdb4b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}] Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 1b970b89c20645d98da510e03a915fd5 Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:51:06.091716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'ac779098-8aa5-40b8-ae7d-dc4e463f015b'} Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:51:06.092863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:51:06.094412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:06.096337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Returning 404 to user: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:51:06.096337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b53ee976-1dc4-48dc-acdc-c70eff17321e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 404 len: 111 microversion: 2.20 time: 0.029653 Jun 08 13:51:06.096337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 254/515] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:06 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:51:06.101603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e40ae826-ddcd-4226-be9f-b2cf70c9b68b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '.version_select at 0x7fe2893e5550>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:06.201909 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e40ae826-ddcd-4226-be9f-b2cf70c9b68b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789774920" status: 204 len: 0 microversion: 2.20 time: 0.104018 Jun 08 13:51:06.202495 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 262/516] 10.222.0.55 () {60 vars in 1258 bytes} [Wed Jun 8 13:51:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789774920 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 08 13:51:07.051746 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9af6d3de-30bc-4827-ae03-48ebf6242f91 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'create', calling method: .version_select at 0x7fe289572af0>, body: {"keypair": {"name": "tempest-keypair-1325981222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOl5YD1qSAdJTy1myxgJHmVHzOeOZGT4wghU40GgddqzVTy+W4cahkV2uV+WvxqB5g8kCUSRyiEDRHHdy4vDYxlMwMeCZATSqG3guVL0uo+cxCxqyLdYcd/77iSWuNqpOQ=="}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:07.066026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-9af6d3de-30bc-4827-ae03-48ebf6242f91 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Getting quotas for project d0cc65fa99694daa81878db0200bdb4b. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:51:07.070317 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-9af6d3de-30bc-4827-ae03-48ebf6242f91 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Getting quotas for user 1b970b89c20645d98da510e03a915fd5 and project d0cc65fa99694daa81878db0200bdb4b. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:51:07.191824 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9af6d3de-30bc-4827-ae03-48ebf6242f91 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.143819 Jun 08 13:51:07.192331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 255/517] 10.222.0.55 () {62 vars in 1199 bytes} [Wed Jun 8 13:51:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 08 13:51:09.471784 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-539331559", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12800c86-d5ba-481d-a55e-8c6ac82045b0"}], "security_groups": [{"name": "tempest-securitygroup--2012597839"}], "key_name": "tempest-keypair-1325981222", "user_data": "}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:09.571768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] validate_networks() for [('12800c86-d5ba-481d-a55e-8c6ac82045b0', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:51:09.941717 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:51:09.942149 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:51:09.942653 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:51:09.943095 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:51:09.943567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:51:09.952992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:09.953519 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:09.954358 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:09.954790 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:09.962552 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:09.973603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Getting quotas for project d0cc65fa99694daa81878db0200bdb4b. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:51:09.977629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Getting quotas for user 1b970b89c20645d98da510e03a915fd5 and project d0cc65fa99694daa81878db0200bdb4b. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:51:09.988787 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:51:09.991025 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:51:10.097834 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f6869ffc-0203-463f-9452-315a72a9a56c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.630799 Jun 08 13:51:10.098631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 263/518] 10.222.0.55 () {62 vars in 1187 bytes} [Wed Jun 8 13:51:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 08 13:51:10.108798 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e104ae06-2c27-43dd-9f47-87b9a20583b8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:10.110174 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e104ae06-2c27-43dd-9f47-87b9a20583b8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:10.168676 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e104ae06-2c27-43dd-9f47-87b9a20583b8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:10.177302 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e104ae06-2c27-43dd-9f47-87b9a20583b8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:10.178964 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e104ae06-2c27-43dd-9f47-87b9a20583b8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:10.180381 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e104ae06-2c27-43dd-9f47-87b9a20583b8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1281 microversion: 2.20 time: 0.075899 Jun 08 13:51:10.180950 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 256/519] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:10 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:11.198929 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:11.199547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:11.207172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:11.207624 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:11.208432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:11.208875 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:11.272301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:11.280085 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:11.281619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:11.282743 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f8892e0b-aa04-4cd5-989c-779c99b283cd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1285 microversion: 2.20 time: 0.087785 Jun 08 13:51:11.288505 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 264/520] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:11 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:12.301531 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:12.311417 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:12.311417 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:12.311417 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:12.311417 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:12.312582 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:12.384992 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:12.394003 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:12.395504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:12.396660 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-34c6d341-07c5-487c-8b0d-a51b050d1bb2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1351 microversion: 2.20 time: 0.099261 Jun 08 13:51:12.397210 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 257/521] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:12 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:13.422523 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:13.423172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:13.430978 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:13.431346 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:13.432129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:13.432562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:13.574113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:13.583891 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:13.585468 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:13.586619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-373ed2ef-af95-4093-9440-951a4c2fa26d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1407 microversion: 2.20 time: 0.168394 Jun 08 13:51:13.587182 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 265/522] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:13 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:14.147933 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-a097a2dd-7cbe-43a2-a590-73e281963742 req-064caafd-2a33-442f-ba55-be5982e95944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab28955-49eb-4750-839f-b9f2b14cb299", "tag": "3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:14.162747 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-a097a2dd-7cbe-43a2-a590-73e281963742 req-064caafd-2a33-442f-ba55-be5982e95944 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:14.163523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-a097a2dd-7cbe-43a2-a590-73e281963742 req-064caafd-2a33-442f-ba55-be5982e95944 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:14.175561 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-a097a2dd-7cbe-43a2-a590-73e281963742 req-064caafd-2a33-442f-ba55-be5982e95944 service nova] Creating event network-changed:3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4 for instance dab28955-49eb-4750-839f-b9f2b14cb299 on hv-cinder-81914 Jun 08 13:51:14.181024 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-a097a2dd-7cbe-43a2-a590-73e281963742 req-064caafd-2a33-442f-ba55-be5982e95944 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036711 Jun 08 13:51:14.181767 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 258/523] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:14.605852 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:14.606582 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:14.608935 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:14.614446 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:14.614891 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:14.615658 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:14.616163 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:14.746216 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:14.754423 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:14.756178 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:14.757311 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a6140943-76f5-40f6-8085-c0417b17c2a6 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1407 microversion: 2.20 time: 0.155344 Jun 08 13:51:14.758041 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 266/524] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:14 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:15.777068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:15.777755 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:15.779681 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:15.785441 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:15.785888 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:15.787161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:15.787161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:15.919346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:15.928211 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:15.929730 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:15.930865 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f81fcaf5-bc52-46bd-885e-738f7c6accb5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1407 microversion: 2.20 time: 0.158612 Jun 08 13:51:15.931422 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 259/525] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:15 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:51:16.949203 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:16.949768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:16.957220 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:16.957663 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:16.958435 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:16.958872 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:17.091737 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:17.102211 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:17.103867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:17.105095 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7603c6cc-1e8d-43c6-9fe2-94ec8a837183 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1407 microversion: 2.20 time: 0.160179 Jun 08 13:51:17.105933 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 267/526] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:16 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:17.836902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f92afcc7-8b73-439b-b2c8-b6598818cfa9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:17.837976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f92afcc7-8b73-439b-b2c8-b6598818cfa9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:17.844510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f92afcc7-8b73-439b-b2c8-b6598818cfa9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:17.844963 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f92afcc7-8b73-439b-b2c8-b6598818cfa9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:17.845733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f92afcc7-8b73-439b-b2c8-b6598818cfa9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:17.846427 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f92afcc7-8b73-439b-b2c8-b6598818cfa9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:17.875833 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f92afcc7-8b73-439b-b2c8-b6598818cfa9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041677 Jun 08 13:51:17.875833 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 260/527] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:51:17 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 08 13:51:17.933509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-af7d1423-b9eb-412f-819c-5ff99940e9dd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:17.934009 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-af7d1423-b9eb-412f-819c-5ff99940e9dd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:17.941148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-af7d1423-b9eb-412f-819c-5ff99940e9dd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:17.941611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-af7d1423-b9eb-412f-819c-5ff99940e9dd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:17.942390 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-af7d1423-b9eb-412f-819c-5ff99940e9dd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:17.942863 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-af7d1423-b9eb-412f-819c-5ff99940e9dd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:17.971585 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-af7d1423-b9eb-412f-819c-5ff99940e9dd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:51:18.122779 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:18.123396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:18.130105 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:18.130497 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:18.131266 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:18.131709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:18.265062 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:18.273112 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:18.277051 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:18.277051 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8fbb00a1-b636-40c1-9ab7-c15f39f3388d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1407 microversion: 2.20 time: 0.156925 Jun 08 13:51:18.277051 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 261/528] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:18 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:51:18.297564 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-af7d1423-b9eb-412f-819c-5ff99940e9dd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 204 len: 0 microversion: 2.1 time: 0.367539 Jun 08 13:51:18.298164 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 268/529] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:51:17 2022] DELETE /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:51:18.306951 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a8759ab0-e873-4e26-8f35-83e97d7ab063 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:18.307732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a8759ab0-e873-4e26-8f35-83e97d7ab063 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:18.314067 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a8759ab0-e873-4e26-8f35-83e97d7ab063 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:18.315253 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a8759ab0-e873-4e26-8f35-83e97d7ab063 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:18.320258 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a8759ab0-e873-4e26-8f35-83e97d7ab063 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:18.320258 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a8759ab0-e873-4e26-8f35-83e97d7ab063 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:18.445076 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a8759ab0-e873-4e26-8f35-83e97d7ab063 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:18.452923 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a8759ab0-e873-4e26-8f35-83e97d7ab063 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1672 microversion: 2.1 time: 0.149948 Jun 08 13:51:18.453684 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 262/530] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:18 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:19.294713 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:19.295427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:19.302132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:19.302586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:19.303365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:19.303806 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:19.472675 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-dc6c2609-12c0-44e4-96f5-bc970e1a33d6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:19.473285 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-dc6c2609-12c0-44e4-96f5-bc970e1a33d6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:19.481024 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dc6c2609-12c0-44e4-96f5-bc970e1a33d6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:19.481487 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dc6c2609-12c0-44e4-96f5-bc970e1a33d6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:19.482759 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dc6c2609-12c0-44e4-96f5-bc970e1a33d6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:19.483128 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-dc6c2609-12c0-44e4-96f5-bc970e1a33d6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:19.502344 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:19.513194 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:19.516568 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:19.516701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3703dc55-25c3-4b6b-98fd-198657d97bb0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1407 microversion: 2.20 time: 0.226339 Jun 08 13:51:19.526938 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 269/531] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:19 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:19.628996 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-dc6c2609-12c0-44e4-96f5-bc970e1a33d6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:19.636635 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-dc6c2609-12c0-44e4-96f5-bc970e1a33d6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1672 microversion: 2.1 time: 0.169720 Jun 08 13:51:19.643765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 263/532] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:19 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:20.535175 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:20.535795 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:20.539377 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:20.539377 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=6 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:20.543385 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:20.543836 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:20.545228 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:20.545667 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:20.658897 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0636cf46-9e34-426e-b30a-72da30b74643 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:20.660612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0636cf46-9e34-426e-b30a-72da30b74643 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:20.668422 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=6 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:20.672034 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0636cf46-9e34-426e-b30a-72da30b74643 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:20.673118 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0636cf46-9e34-426e-b30a-72da30b74643 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:20.674930 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0636cf46-9e34-426e-b30a-72da30b74643 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:20.675745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0636cf46-9e34-426e-b30a-72da30b74643 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:20.695036 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:20.707660 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:20.710346 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:20.712355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4e650488-a805-4a65-9ef2-2953c9f4c0b4 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1407 microversion: 2.20 time: 0.180865 Jun 08 13:51:20.714163 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 270/533] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:20 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:20.843248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0636cf46-9e34-426e-b30a-72da30b74643 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:20.851449 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0636cf46-9e34-426e-b30a-72da30b74643 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1672 microversion: 2.1 time: 0.200505 Jun 08 13:51:20.852657 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 264/534] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:20 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1672 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:20.885267 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-6e9d5968-fb3a-49d0-b7d4-c8918ac29df2 req-b22bf742-03c5-4e34-9937-d63bdbfc869e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab28955-49eb-4750-839f-b9f2b14cb299", "name": "network-vif-plugged", "status": "completed", "tag": "3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:20.894383 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-6e9d5968-fb3a-49d0-b7d4-c8918ac29df2 req-b22bf742-03c5-4e34-9937-d63bdbfc869e service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:20.894830 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-6e9d5968-fb3a-49d0-b7d4-c8918ac29df2 req-b22bf742-03c5-4e34-9937-d63bdbfc869e service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:20.907483 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-6e9d5968-fb3a-49d0-b7d4-c8918ac29df2 req-b22bf742-03c5-4e34-9937-d63bdbfc869e service nova] Creating event network-vif-plugged:3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4 for instance dab28955-49eb-4750-839f-b9f2b14cb299 on hv-cinder-81914 Jun 08 13:51:20.913895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-6e9d5968-fb3a-49d0-b7d4-c8918ac29df2 req-b22bf742-03c5-4e34-9937-d63bdbfc869e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032845 Jun 08 13:51:20.914727 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 271/535] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:21.733100 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:21.740498 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:21.742953 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:21.743486 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:21.744561 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:21.745008 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:21.869786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-072f1fcb-199f-449c-b515-fb986b25591b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:21.870509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-072f1fcb-199f-449c-b515-fb986b25591b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:21.883446 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-072f1fcb-199f-449c-b515-fb986b25591b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:21.883906 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-072f1fcb-199f-449c-b515-fb986b25591b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:21.884739 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-072f1fcb-199f-449c-b515-fb986b25591b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:21.885197 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-072f1fcb-199f-449c-b515-fb986b25591b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:21.930025 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:21.938779 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:21.941825 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:21.943668 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-048f50e0-063b-433c-961b-702332af525c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1407 microversion: 2.20 time: 0.214789 Jun 08 13:51:21.944489 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 265/536] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:21 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:22.012711 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-072f1fcb-199f-449c-b515-fb986b25591b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:22.025798 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-072f1fcb-199f-449c-b515-fb986b25591b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1606 microversion: 2.1 time: 0.160185 Jun 08 13:51:22.027158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 272/537] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:21 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1606 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:22.318027 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-12c1a340-62ff-4ed7-8433-41bd65e285cc req-5d215526-0c27-4a73-bdf9-bac2ec149758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1db0ac6d-b933-4abd-96b8-c1af36e06791", "name": "network-vif-deleted", "tag": "38bbf42f-b3f0-44a4-992c-b83e8f85c80a"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:22.326163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-12c1a340-62ff-4ed7-8433-41bd65e285cc req-5d215526-0c27-4a73-bdf9-bac2ec149758 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:22.326619 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-12c1a340-62ff-4ed7-8433-41bd65e285cc req-5d215526-0c27-4a73-bdf9-bac2ec149758 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:22.340092 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-12c1a340-62ff-4ed7-8433-41bd65e285cc req-5d215526-0c27-4a73-bdf9-bac2ec149758 service nova] Creating event network-vif-deleted:38bbf42f-b3f0-44a4-992c-b83e8f85c80a for instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 on hv-cinder-81914 Jun 08 13:51:22.347270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-12c1a340-62ff-4ed7-8433-41bd65e285cc req-5d215526-0c27-4a73-bdf9-bac2ec149758 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032408 Jun 08 13:51:22.347878 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 266/538] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:22.962542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:22.963710 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:22.972145 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:22.972710 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:22.973816 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:22.974350 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:23.043672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:23.044578 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:23.057992 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:23.058448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:23.059480 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:23.059961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:23.097262 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:23.097773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:23.098894 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lazy-loading 'fault' on Instance uuid 1db0ac6d-b933-4abd-96b8-c1af36e06791 {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:51:23.183057 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:23.193133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a5b5f2f1-9972-4a92-99af-2f9376f55bfb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 200 len: 1328 microversion: 2.1 time: 0.153639 Jun 08 13:51:23.194323 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 267/539] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:23 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 1328 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:23.229185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:23.238870 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:23.240590 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:23.241940 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7efcca74-8e54-4855-89c0-cdfe7057ad59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1407 microversion: 2.20 time: 0.283487 Jun 08 13:51:23.243010 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 273/540] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:22 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:24.212150 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:24.212770 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:24.221917 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:24.222789 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:24.223785 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:24.224914 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:24.239578 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] HTTP exception thrown: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Request method failure captured: Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 HTTP/1.1 Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKhHqjft3HBeUZKCWjBMOPkII-exZlh-hWeMREZnVp8E_OUiCUwRUzOwYKz1P3SfkoXKMEtdptMv-cMyAKZzKE69pLnR2WUHgcSjBprJKrPYhWIDAOKxLF0RdX6UZYMJFdc1GEb9qWLGQHr9jUBHt3Na-kqPeRlKeXzO2iwUo85WYFU Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:51:24.243965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_87c115dc845a497292c12e2980e9f77b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}] Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: cc438414709747599fba278ea9b6fecf Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:51:24.245331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '1db0ac6d-b933-4abd-96b8-c1af36e06791'} Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:51:24.246068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:51:24.247245 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:51:24.251126 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Returning 404 to user: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:51:24.252961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3c94df60-e382-41f2-81cd-9b752d188440 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 404 len: 111 microversion: 2.1 time: 0.044509 Jun 08 13:51:24.253775 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 268/541] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:24 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:51:24.266793 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:24.269617 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:24.281820 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:24.286136 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:24.287308 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:24.288562 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-663a1f09-4616-44ca-95e7-7a86934f89f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '.version_select at 0x7fe289624ca0>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:24.289231 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:24.422018 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-663a1f09-4616-44ca-95e7-7a86934f89f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691173796" status: 202 len: 0 microversion: 2.1 time: 0.146362 Jun 08 13:51:24.422796 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 269/542] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 8 13:51:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691173796 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:51:24.465850 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:24.476796 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:24.478641 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:24.480013 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9388a07a-a07d-45cf-b4f9-261f244f9894 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1597 microversion: 2.20 time: 0.220204 Jun 08 13:51:24.482421 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 274/543] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:51:24 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1597 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:51:24.508260 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2a02f324-3b6f-47b4-9a64-fc0360c036bf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:24.509011 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2a02f324-3b6f-47b4-9a64-fc0360c036bf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:24.516962 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a02f324-3b6f-47b4-9a64-fc0360c036bf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:24.517986 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a02f324-3b6f-47b4-9a64-fc0360c036bf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:24.522580 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a02f324-3b6f-47b4-9a64-fc0360c036bf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:24.522580 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a02f324-3b6f-47b4-9a64-fc0360c036bf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:24.608246 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2a02f324-3b6f-47b4-9a64-fc0360c036bf tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.104361 Jun 08 13:51:24.609386 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 270/544] 10.222.0.55 () {60 vars in 1315 bytes} [Wed Jun 8 13:51:24 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:51:24.864591 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5fb1771f-72bf-4088-94f0-87464dcc6084 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:24.864591 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5fb1771f-72bf-4088-94f0-87464dcc6084 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:24.870128 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5fb1771f-72bf-4088-94f0-87464dcc6084 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:24.870579 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5fb1771f-72bf-4088-94f0-87464dcc6084 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:24.871355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5fb1771f-72bf-4088-94f0-87464dcc6084 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:24.871856 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5fb1771f-72bf-4088-94f0-87464dcc6084 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:25.012797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-5fb1771f-72bf-4088-94f0-87464dcc6084 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lazy-loading 'services' on Instance uuid 777c65ea-2412-4080-9c2c-ee5201184c1e {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:51:25.289118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5fb1771f-72bf-4088-94f0-87464dcc6084 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "DELETE /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments/6b8f962d-8544-48ff-bb7d-38ace7613cc6" status: 202 len: 0 microversion: 2.1 time: 0.429973 Jun 08 13:51:25.301916 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1d2b239b-f562-43ed-844a-3c8109cf0a4d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:25.303589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1d2b239b-f562-43ed-844a-3c8109cf0a4d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:25.306755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 275/545] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:51:24 2022] DELETE /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments/6b8f962d-8544-48ff-bb7d-38ace7613cc6 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:51:25.322086 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1d2b239b-f562-43ed-844a-3c8109cf0a4d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:25.322751 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1d2b239b-f562-43ed-844a-3c8109cf0a4d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:25.327153 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1d2b239b-f562-43ed-844a-3c8109cf0a4d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:25.329127 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1d2b239b-f562-43ed-844a-3c8109cf0a4d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:25.383662 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1d2b239b-f562-43ed-844a-3c8109cf0a4d tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088957 Jun 08 13:51:25.389495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 271/546] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:51:25 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:26.199192 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1e3dba78-672e-449c-b3f7-02fa8fa128bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:26.200306 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1e3dba78-672e-449c-b3f7-02fa8fa128bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:26.219222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-6a167a93-9f50-4613-88ee-dc422e637abc req-5190201f-92c1-43b3-a1bb-d9af48783198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab28955-49eb-4750-839f-b9f2b14cb299", "tag": "3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:26.244668 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e3dba78-672e-449c-b3f7-02fa8fa128bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:26.246062 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-6a167a93-9f50-4613-88ee-dc422e637abc req-5190201f-92c1-43b3-a1bb-d9af48783198 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:26.246412 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e3dba78-672e-449c-b3f7-02fa8fa128bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:26.247173 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-6a167a93-9f50-4613-88ee-dc422e637abc req-5190201f-92c1-43b3-a1bb-d9af48783198 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:26.248927 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e3dba78-672e-449c-b3f7-02fa8fa128bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:26.255573 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e3dba78-672e-449c-b3f7-02fa8fa128bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:26.280879 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-6a167a93-9f50-4613-88ee-dc422e637abc req-5190201f-92c1-43b3-a1bb-d9af48783198 service nova] Creating event network-changed:3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4 for instance dab28955-49eb-4750-839f-b9f2b14cb299 on hv-cinder-81914 Jun 08 13:51:26.293214 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-6a167a93-9f50-4613-88ee-dc422e637abc req-5190201f-92c1-43b3-a1bb-d9af48783198 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077068 Jun 08 13:51:26.293998 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 272/547] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:51:26.397235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5e7254f2-803b-4e1f-85d0-6d4e15258b01 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:26.398640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5e7254f2-803b-4e1f-85d0-6d4e15258b01 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:26.407176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5e7254f2-803b-4e1f-85d0-6d4e15258b01 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:26.411061 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5e7254f2-803b-4e1f-85d0-6d4e15258b01 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:26.411061 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5e7254f2-803b-4e1f-85d0-6d4e15258b01 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:26.411061 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5e7254f2-803b-4e1f-85d0-6d4e15258b01 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:26.462571 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5e7254f2-803b-4e1f-85d0-6d4e15258b01 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071076 Jun 08 13:51:26.464210 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 273/548] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:51:26 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:26.476439 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3ba7c827-4d5a-47e0-92ee-b4b13c9fea4e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'create', calling method: .version_select at 0x7fe2894d25e0>, body: {"keypair": {"name": "tempest-keypair-297616838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJElW0ggMmNUthKJNvJRNaSozCzv7HFi+cMLeceOGvk6Uzl4pc/wcbBh6+0Fl1iAIeixdB8CQccvPG3y9XY8XiA/gLL138fNKj3zrkCExP3fHetrcTYAAlpZ2YqFa5pQqg=="}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:26.499955 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-3ba7c827-4d5a-47e0-92ee-b4b13c9fea4e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Getting quotas for project 87c115dc845a497292c12e2980e9f77b. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:51:26.507265 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-3ba7c827-4d5a-47e0-92ee-b4b13c9fea4e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Getting quotas for user cc438414709747599fba278ea9b6fecf and project 87c115dc845a497292c12e2980e9f77b. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:51:26.550565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1e3dba78-672e-449c-b3f7-02fa8fa128bb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "POST /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/action" status: 202 len: 0 microversion: 2.1 time: 0.355262 Jun 08 13:51:26.551833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 276/549] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:51:26 2022] POST /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:51:26.562362 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d70b87d0-ccfe-4d2a-854b-505e296bde51 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:26.563563 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d70b87d0-ccfe-4d2a-854b-505e296bde51 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:26.577284 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d70b87d0-ccfe-4d2a-854b-505e296bde51 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:26.580566 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d70b87d0-ccfe-4d2a-854b-505e296bde51 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:26.581580 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d70b87d0-ccfe-4d2a-854b-505e296bde51 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:26.582024 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d70b87d0-ccfe-4d2a-854b-505e296bde51 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:26.659165 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3ba7c827-4d5a-47e0-92ee-b4b13c9fea4e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183772 Jun 08 13:51:26.659850 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 274/550] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 13:51:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:26.790928 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d70b87d0-ccfe-4d2a-854b-505e296bde51 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:26.793851 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:26.804548 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d70b87d0-ccfe-4d2a-854b-505e296bde51 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1752 microversion: 2.1 time: 0.247537 Jun 08 13:51:26.805579 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 277/551] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:26 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:27.478175 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-676d2d07-7043-497a-be6f-a3c9bf1b2917 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:27.484703 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-676d2d07-7043-497a-be6f-a3c9bf1b2917 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:27.513060 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-676d2d07-7043-497a-be6f-a3c9bf1b2917 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:27.513519 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-676d2d07-7043-497a-be6f-a3c9bf1b2917 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:27.514318 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-676d2d07-7043-497a-be6f-a3c9bf1b2917 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:27.521087 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-676d2d07-7043-497a-be6f-a3c9bf1b2917 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:27.558176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-676d2d07-7043-497a-be6f-a3c9bf1b2917 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085861 Jun 08 13:51:27.559524 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 275/552] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:51:27 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:51:27.662035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-da41934c-a350-4da6-9637-6488cd15678f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:27.662538 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-da41934c-a350-4da6-9637-6488cd15678f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:27.673455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-da41934c-a350-4da6-9637-6488cd15678f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:27.673949 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-da41934c-a350-4da6-9637-6488cd15678f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:27.674787 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-da41934c-a350-4da6-9637-6488cd15678f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:27.675233 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-da41934c-a350-4da6-9637-6488cd15678f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:27.710366 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-da41934c-a350-4da6-9637-6488cd15678f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:51:27.822759 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-93f06f08-3681-4e44-9797-4454e4047744 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:27.823365 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-93f06f08-3681-4e44-9797-4454e4047744 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:27.830205 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-93f06f08-3681-4e44-9797-4454e4047744 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:27.830765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-93f06f08-3681-4e44-9797-4454e4047744 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:27.832134 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-93f06f08-3681-4e44-9797-4454e4047744 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:27.832134 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-93f06f08-3681-4e44-9797-4454e4047744 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:28.068844 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-93f06f08-3681-4e44-9797-4454e4047744 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:28.078562 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-93f06f08-3681-4e44-9797-4454e4047744 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1752 microversion: 2.1 time: 0.259611 Jun 08 13:51:28.091475 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 276/553] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:27 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:28.186260 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-da41934c-a350-4da6-9637-6488cd15678f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "DELETE /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 204 len: 0 microversion: 2.1 time: 0.531377 Jun 08 13:51:28.187687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 278/554] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:51:27 2022] DELETE /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:51:28.196714 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-55a6f250-f25c-4219-b8c0-6dda4d7e525a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:28.197842 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-55a6f250-f25c-4219-b8c0-6dda4d7e525a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:28.205264 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55a6f250-f25c-4219-b8c0-6dda4d7e525a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:28.206069 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55a6f250-f25c-4219-b8c0-6dda4d7e525a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:28.207025 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55a6f250-f25c-4219-b8c0-6dda4d7e525a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:28.207626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55a6f250-f25c-4219-b8c0-6dda4d7e525a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:28.405570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-55a6f250-f25c-4219-b8c0-6dda4d7e525a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:28.418269 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-55a6f250-f25c-4219-b8c0-6dda4d7e525a tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1688 microversion: 2.1 time: 0.225200 Jun 08 13:51:28.422205 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 277/555] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:28 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1688 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:29.097725 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f32d891c-2bf4-476e-b8b9-55e56c17ab33 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:29.098440 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f32d891c-2bf4-476e-b8b9-55e56c17ab33 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:29.105473 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f32d891c-2bf4-476e-b8b9-55e56c17ab33 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:29.105925 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f32d891c-2bf4-476e-b8b9-55e56c17ab33 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:29.106697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f32d891c-2bf4-476e-b8b9-55e56c17ab33 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:29.107134 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f32d891c-2bf4-476e-b8b9-55e56c17ab33 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:29.343729 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f32d891c-2bf4-476e-b8b9-55e56c17ab33 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:29.357910 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f32d891c-2bf4-476e-b8b9-55e56c17ab33 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.264868 Jun 08 13:51:29.358308 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 279/556] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:29 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:29.437670 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-274d901d-ccf7-4bd1-8c19-153ccf74cf10 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:29.438423 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-274d901d-ccf7-4bd1-8c19-153ccf74cf10 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:29.445868 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-274d901d-ccf7-4bd1-8c19-153ccf74cf10 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:29.446380 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-274d901d-ccf7-4bd1-8c19-153ccf74cf10 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:29.447225 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-274d901d-ccf7-4bd1-8c19-153ccf74cf10 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:29.447702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-274d901d-ccf7-4bd1-8c19-153ccf74cf10 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:29.452188 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=100 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:29.711413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-274d901d-ccf7-4bd1-8c19-153ccf74cf10 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:29.724215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-274d901d-ccf7-4bd1-8c19-153ccf74cf10 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1688 microversion: 2.1 time: 0.290862 Jun 08 13:51:29.725120 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 278/557] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:29 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1688 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:30.304341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1578897544", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42d99904-a8b4-4285-872c-5a43c79568a6"}], "security_groups": [{"name": "tempest-securitygroup--497399983"}], "key_name": "tempest-keypair-297616838", "user_data": "}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:30.375526 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-232bf5f9-95e0-49fd-8ab8-e4c1b60f2793 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:30.376328 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-232bf5f9-95e0-49fd-8ab8-e4c1b60f2793 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:30.382930 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-232bf5f9-95e0-49fd-8ab8-e4c1b60f2793 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:30.383377 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-232bf5f9-95e0-49fd-8ab8-e4c1b60f2793 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:30.384176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-232bf5f9-95e0-49fd-8ab8-e4c1b60f2793 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:30.384788 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-232bf5f9-95e0-49fd-8ab8-e4c1b60f2793 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:30.424094 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] validate_networks() for [('42d99904-a8b4-4285-872c-5a43c79568a6', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:51:30.692746 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-232bf5f9-95e0-49fd-8ab8-e4c1b60f2793 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:30.701973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-232bf5f9-95e0-49fd-8ab8-e4c1b60f2793 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.330675 Jun 08 13:51:30.703126 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 279/558] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:30 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:30.743764 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b61d2c6a-1a2d-4a1c-8883-7aeff38b5aad tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:30.744535 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b61d2c6a-1a2d-4a1c-8883-7aeff38b5aad tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:30.759069 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b61d2c6a-1a2d-4a1c-8883-7aeff38b5aad tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:30.760506 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b61d2c6a-1a2d-4a1c-8883-7aeff38b5aad tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:30.764195 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b61d2c6a-1a2d-4a1c-8883-7aeff38b5aad tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:30.764829 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b61d2c6a-1a2d-4a1c-8883-7aeff38b5aad tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:31.023753 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b61d2c6a-1a2d-4a1c-8883-7aeff38b5aad tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:31.031740 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b61d2c6a-1a2d-4a1c-8883-7aeff38b5aad tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1688 microversion: 2.1 time: 0.293505 Jun 08 13:51:31.033872 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 280/559] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:30 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1688 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:31.065693 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:51:31.066117 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:51:31.066589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:51:31.066990 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:51:31.067395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:51:31.076501 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:31.077056 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:31.077716 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:31.078154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:31.102178 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Getting quotas for project 87c115dc845a497292c12e2980e9f77b. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:51:31.106097 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Getting quotas for user cc438414709747599fba278ea9b6fecf and project 87c115dc845a497292c12e2980e9f77b. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:51:31.119172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:51:31.121469 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:51:31.253110 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1bde3a98-9230-46ce-8658-b12e4a703117 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.953059 Jun 08 13:51:31.254447 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 280/560] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:51:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:51:31.265114 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-61ee1bde-c856-4e35-906b-152ff61a95b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:31.268997 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-61ee1bde-c856-4e35-906b-152ff61a95b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:31.722546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-cd3d307d-20d0-460b-becb-89ff57b34877 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:31.722546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-cd3d307d-20d0-460b-becb-89ff57b34877 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:31.727725 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cd3d307d-20d0-460b-becb-89ff57b34877 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:31.728420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cd3d307d-20d0-460b-becb-89ff57b34877 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:31.729601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cd3d307d-20d0-460b-becb-89ff57b34877 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:31.730202 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cd3d307d-20d0-460b-becb-89ff57b34877 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:31.877061 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-61ee1bde-c856-4e35-906b-152ff61a95b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:31.886732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-61ee1bde-c856-4e35-906b-152ff61a95b7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1237 microversion: 2.1 time: 0.626364 Jun 08 13:51:31.898830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 281/561] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:31 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1237 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:32.050989 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-50051fbc-6340-4262-8a5c-556e22aabdf3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:32.052021 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-50051fbc-6340-4262-8a5c-556e22aabdf3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:32.058437 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-50051fbc-6340-4262-8a5c-556e22aabdf3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:32.059224 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-50051fbc-6340-4262-8a5c-556e22aabdf3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:32.060292 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-50051fbc-6340-4262-8a5c-556e22aabdf3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:32.060962 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-50051fbc-6340-4262-8a5c-556e22aabdf3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:32.340259 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-cd3d307d-20d0-460b-becb-89ff57b34877 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:32.349302 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-cd3d307d-20d0-460b-becb-89ff57b34877 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.634397 Jun 08 13:51:32.349877 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 281/562] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:31 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:32.447993 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-50051fbc-6340-4262-8a5c-556e22aabdf3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:32.466185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-50051fbc-6340-4262-8a5c-556e22aabdf3 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1688 microversion: 2.1 time: 0.419791 Jun 08 13:51:32.469386 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 282/563] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:32 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1688 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:32.906455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2ca8bc7c-d5a3-43ca-9faa-9cdfcbe30012 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:32.908875 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2ca8bc7c-d5a3-43ca-9faa-9cdfcbe30012 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:32.925441 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2ca8bc7c-d5a3-43ca-9faa-9cdfcbe30012 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:32.926184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2ca8bc7c-d5a3-43ca-9faa-9cdfcbe30012 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:32.927258 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2ca8bc7c-d5a3-43ca-9faa-9cdfcbe30012 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:32.927891 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2ca8bc7c-d5a3-43ca-9faa-9cdfcbe30012 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:33.144799 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-62bd1109-5a01-417b-940d-f873e7c1da78 req-c47624bd-b9d7-4e80-b62c-869bbb6d1e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777c65ea-2412-4080-9c2c-ee5201184c1e", "name": "network-vif-deleted", "tag": "d1b9ce5f-7ee5-4967-93f0-2a76e3005b21"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:33.146522 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2ca8bc7c-d5a3-43ca-9faa-9cdfcbe30012 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:33.155784 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2ca8bc7c-d5a3-43ca-9faa-9cdfcbe30012 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1241 microversion: 2.1 time: 0.252856 Jun 08 13:51:33.157002 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 282/564] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:32 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1241 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:33.160521 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-62bd1109-5a01-417b-940d-f873e7c1da78 req-c47624bd-b9d7-4e80-b62c-869bbb6d1e99 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:33.160975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-62bd1109-5a01-417b-940d-f873e7c1da78 req-c47624bd-b9d7-4e80-b62c-869bbb6d1e99 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:33.186854 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-62bd1109-5a01-417b-940d-f873e7c1da78 req-c47624bd-b9d7-4e80-b62c-869bbb6d1e99 service nova] Creating event network-vif-deleted:d1b9ce5f-7ee5-4967-93f0-2a76e3005b21 for instance 777c65ea-2412-4080-9c2c-ee5201184c1e on hv-cinder-81914 Jun 08 13:51:33.198185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-62bd1109-5a01-417b-940d-f873e7c1da78 req-c47624bd-b9d7-4e80-b62c-869bbb6d1e99 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058235 Jun 08 13:51:33.198688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 283/565] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:33.367931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-62af0d9a-fd03-4b95-921d-8f03c734ae46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:33.368936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-62af0d9a-fd03-4b95-921d-8f03c734ae46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:33.381819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-62af0d9a-fd03-4b95-921d-8f03c734ae46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:33.382831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-62af0d9a-fd03-4b95-921d-8f03c734ae46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:33.384099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-62af0d9a-fd03-4b95-921d-8f03c734ae46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:33.385234 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-62af0d9a-fd03-4b95-921d-8f03c734ae46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:33.488172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-95558458-f3f1-42d6-a414-174763147d8c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:33.490177 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-95558458-f3f1-42d6-a414-174763147d8c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:33.504453 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-95558458-f3f1-42d6-a414-174763147d8c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:33.504919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-95558458-f3f1-42d6-a414-174763147d8c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:33.505720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-95558458-f3f1-42d6-a414-174763147d8c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:33.510228 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-95558458-f3f1-42d6-a414-174763147d8c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:33.701600 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-95558458-f3f1-42d6-a414-174763147d8c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:33.722175 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-95558458-f3f1-42d6-a414-174763147d8c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 200 len: 1329 microversion: 2.1 time: 0.238930 Jun 08 13:51:33.737543 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 284/566] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:33 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 1329 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:33.746254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-62af0d9a-fd03-4b95-921d-8f03c734ae46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:33.757439 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-62af0d9a-fd03-4b95-921d-8f03c734ae46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.393764 Jun 08 13:51:33.764304 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 283/567] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:33 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:34.174164 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3adab29e-f4d1-4758-9d70-dca5c159338d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:34.178152 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3adab29e-f4d1-4758-9d70-dca5c159338d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:34.183377 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3adab29e-f4d1-4758-9d70-dca5c159338d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:34.183830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3adab29e-f4d1-4758-9d70-dca5c159338d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:34.193397 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3adab29e-f4d1-4758-9d70-dca5c159338d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:34.193981 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3adab29e-f4d1-4758-9d70-dca5c159338d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:34.289974 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3adab29e-f4d1-4758-9d70-dca5c159338d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:34.301817 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3adab29e-f4d1-4758-9d70-dca5c159338d tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1297 microversion: 2.1 time: 0.130659 Jun 08 13:51:34.303611 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 285/568] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:34 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1297 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:34.745399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:34.753356 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: 777c65ea-2412-4080-9c2c-ee5201184c1e] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:34.754629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:34.755183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:34.756227 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:34.756908 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:34.774793 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1bb2a66b-9bf1-47bb-b08c-c75cf906d430 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:34.775442 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1bb2a66b-9bf1-47bb-b08c-c75cf906d430 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:34.782028 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] HTTP exception thrown: Instance 777c65ea-2412-4080-9c2c-ee5201184c1e could not be found. Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Request method failure captured: Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e HTTP/1.1 Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKhWmfjOgbqK2CSJHSTKHI6IveJnrM8w8UarJX_JvlVysiZhXg0V18KvvGG7aQd3UMsLFAxPtqLUvG2Maio6jvXsfWlGOgxowjEe9EDmba_uZYDLft_fZhEENfYo3NaDrW-mUQ0ZlWIC2i-YGG46CWiTxjeCvMUZ7p4mPis_UMDRHL8 Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:51:34.782954 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9abd79bc99784c3f81991d1cae37a074", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}] Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 85e0d647620a407cbe03d83c86111f3d Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance 777c65ea-2412-4080-9c2c-ee5201184c1e could not be found. Jun 08 13:51:34.785065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '777c65ea-2412-4080-9c2c-ee5201184c1e'} Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777c65ea-2412-4080-9c2c-ee5201184c1e could not be found. Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:51:34.785969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777c65ea-2412-4080-9c2c-ee5201184c1e could not be found. Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777c65ea-2412-4080-9c2c-ee5201184c1e could not be found. Jun 08 13:51:34.787455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:34.788963 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Returning 404 to user: Instance 777c65ea-2412-4080-9c2c-ee5201184c1e could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:51:34.790341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-79587d75-5753-4faa-99a6-dba95b239099 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e" status: 404 len: 111 microversion: 2.1 time: 0.046837 Jun 08 13:51:34.790836 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 284/569] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:34 2022] GET /compute/v2.1/servers/777c65ea-2412-4080-9c2c-ee5201184c1e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:51:34.794200 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1bb2a66b-9bf1-47bb-b08c-c75cf906d430 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:34.794669 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1bb2a66b-9bf1-47bb-b08c-c75cf906d430 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:34.800121 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1bb2a66b-9bf1-47bb-b08c-c75cf906d430 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:34.805026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1bb2a66b-9bf1-47bb-b08c-c75cf906d430 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:34.807206 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6623d331-b360-44b7-9bbd-372039975a0f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '.version_select at 0x7fe2894ce700>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:34.900943 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6623d331-b360-44b7-9bbd-372039975a0f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-264101866" status: 202 len: 0 microversion: 2.1 time: 0.105989 Jun 08 13:51:34.901602 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 285/570] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 8 13:51:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-264101866 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:51:35.084850 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1bb2a66b-9bf1-47bb-b08c-c75cf906d430 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:35.097314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1bb2a66b-9bf1-47bb-b08c-c75cf906d430 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.326332 Jun 08 13:51:35.109811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 286/571] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:34 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:35.163681 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-372d6d0d-6a61-445e-9e22-03566947b8cd tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Action: 'create', calling method: .version_select at 0x7fe289568d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1972270106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdAw7FfmQ6Ois0amj/XOGV1a8TP3/S1XNWVYw7JecWClgw735F3abUK+00l/orHV8AoYPBObJ0oO1mcMev07uZb9BJQmYTl/b+hwVtcD3KxtV8drrTMa0mnUv42DLjXXQ=="}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:35.182990 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-372d6d0d-6a61-445e-9e22-03566947b8cd tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Getting quotas for project 708bec67bbb748b382b82cd0da768d5c. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:51:35.186987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-372d6d0d-6a61-445e-9e22-03566947b8cd tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Getting quotas for user 24e3c65a8b344e4e893c3ebf436ac660 and project 708bec67bbb748b382b82cd0da768d5c. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:51:35.319227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7a867cf5-9c2d-42ff-845d-4e88dc4f0867 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:35.319836 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7a867cf5-9c2d-42ff-845d-4e88dc4f0867 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:35.325991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a867cf5-9c2d-42ff-845d-4e88dc4f0867 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:35.329828 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a867cf5-9c2d-42ff-845d-4e88dc4f0867 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:35.329828 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a867cf5-9c2d-42ff-845d-4e88dc4f0867 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:35.329828 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7a867cf5-9c2d-42ff-845d-4e88dc4f0867 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:35.353001 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-372d6d0d-6a61-445e-9e22-03566947b8cd tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.412892 Jun 08 13:51:35.353673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 286/572] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 13:51:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:35.493563 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7a867cf5-9c2d-42ff-845d-4e88dc4f0867 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:35.503421 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7a867cf5-9c2d-42ff-845d-4e88dc4f0867 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.188160 Jun 08 13:51:35.506923 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 287/573] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:35 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:36.117812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-33f09251-3151-4599-b4d8-467a17e97780 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:36.119147 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-33f09251-3151-4599-b4d8-467a17e97780 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:36.136655 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-33f09251-3151-4599-b4d8-467a17e97780 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:36.137511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-33f09251-3151-4599-b4d8-467a17e97780 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:36.140098 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-33f09251-3151-4599-b4d8-467a17e97780 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:36.142384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-33f09251-3151-4599-b4d8-467a17e97780 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:36.304551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-33f09251-3151-4599-b4d8-467a17e97780 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:36.315901 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-33f09251-3151-4599-b4d8-467a17e97780 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.202291 Jun 08 13:51:36.316867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 287/574] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:36 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:36.524897 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-26982dae-6ee4-4b3b-8fc6-2ff2c1238991 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:36.525598 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-26982dae-6ee4-4b3b-8fc6-2ff2c1238991 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:36.531996 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-26982dae-6ee4-4b3b-8fc6-2ff2c1238991 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:36.533534 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-26982dae-6ee4-4b3b-8fc6-2ff2c1238991 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:36.534553 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-26982dae-6ee4-4b3b-8fc6-2ff2c1238991 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:36.540933 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-26982dae-6ee4-4b3b-8fc6-2ff2c1238991 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:36.643520 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-1682733f-373c-4c70-9532-1ed67d983ef6 req-f01dbfdd-9684-4b83-88f2-06ec1343808a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff8382d-1fa6-4dbf-8c24-24e8d31e9323", "tag": "bae22dd8-6da6-4295-940a-640e10580990"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:36.660179 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-1682733f-373c-4c70-9532-1ed67d983ef6 req-f01dbfdd-9684-4b83-88f2-06ec1343808a service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:36.660934 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-1682733f-373c-4c70-9532-1ed67d983ef6 req-f01dbfdd-9684-4b83-88f2-06ec1343808a service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:36.679705 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-1682733f-373c-4c70-9532-1ed67d983ef6 req-f01dbfdd-9684-4b83-88f2-06ec1343808a service nova] Creating event network-changed:bae22dd8-6da6-4295-940a-640e10580990 for instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 on hv-cinder-81914 Jun 08 13:51:36.685187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-1682733f-373c-4c70-9532-1ed67d983ef6 req-f01dbfdd-9684-4b83-88f2-06ec1343808a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045621 Jun 08 13:51:36.685792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 288/575] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:51:36.730140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-26982dae-6ee4-4b3b-8fc6-2ff2c1238991 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:36.741282 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-26982dae-6ee4-4b3b-8fc6-2ff2c1238991 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.221524 Jun 08 13:51:36.755670 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 288/576] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:36 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:37.335759 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-002cfd68-ac3b-4002-88e0-9d1068b4341b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:37.336597 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-002cfd68-ac3b-4002-88e0-9d1068b4341b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:37.343219 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-002cfd68-ac3b-4002-88e0-9d1068b4341b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:37.343750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-002cfd68-ac3b-4002-88e0-9d1068b4341b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:37.345205 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-002cfd68-ac3b-4002-88e0-9d1068b4341b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:37.346122 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-002cfd68-ac3b-4002-88e0-9d1068b4341b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:37.636538 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-002cfd68-ac3b-4002-88e0-9d1068b4341b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:37.645528 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-002cfd68-ac3b-4002-88e0-9d1068b4341b tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.315050 Jun 08 13:51:37.646101 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 289/577] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:37 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:37.758947 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e3649c7a-4f1b-4fa5-9419-f99be0ac09fb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:37.763721 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e3649c7a-4f1b-4fa5-9419-f99be0ac09fb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:37.768694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e3649c7a-4f1b-4fa5-9419-f99be0ac09fb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:37.769503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e3649c7a-4f1b-4fa5-9419-f99be0ac09fb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:37.770659 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e3649c7a-4f1b-4fa5-9419-f99be0ac09fb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:37.771379 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e3649c7a-4f1b-4fa5-9419-f99be0ac09fb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:38.033932 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e3649c7a-4f1b-4fa5-9419-f99be0ac09fb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:38.042108 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e3649c7a-4f1b-4fa5-9419-f99be0ac09fb tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.287533 Jun 08 13:51:38.062661 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 289/578] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:37 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:38.668171 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b197c51b-ff50-43d4-a7d4-fcf8db05d9cb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:38.669126 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b197c51b-ff50-43d4-a7d4-fcf8db05d9cb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:38.680550 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b197c51b-ff50-43d4-a7d4-fcf8db05d9cb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:38.681147 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b197c51b-ff50-43d4-a7d4-fcf8db05d9cb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:38.682550 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b197c51b-ff50-43d4-a7d4-fcf8db05d9cb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:38.690622 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b197c51b-ff50-43d4-a7d4-fcf8db05d9cb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:38.782951 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-110b62d6-c69c-4eab-a599-1aeef3f3ee93 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:38.782951 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-110b62d6-c69c-4eab-a599-1aeef3f3ee93 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:38.791115 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-110b62d6-c69c-4eab-a599-1aeef3f3ee93 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:38.792414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-110b62d6-c69c-4eab-a599-1aeef3f3ee93 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:38.793620 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-110b62d6-c69c-4eab-a599-1aeef3f3ee93 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:38.794323 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-110b62d6-c69c-4eab-a599-1aeef3f3ee93 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:38.826972 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-110b62d6-c69c-4eab-a599-1aeef3f3ee93 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Going to try to terminate instance {{(pid=124628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:51:38.891207 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b197c51b-ff50-43d4-a7d4-fcf8db05d9cb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:38.900074 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b197c51b-ff50-43d4-a7d4-fcf8db05d9cb tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.240251 Jun 08 13:51:38.900944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 290/579] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:38 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:39.058918 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d5ad1fea-c20b-41ba-8ba8-c962e0909316 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:39.059616 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d5ad1fea-c20b-41ba-8ba8-c962e0909316 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:39.066534 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d5ad1fea-c20b-41ba-8ba8-c962e0909316 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:39.067184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d5ad1fea-c20b-41ba-8ba8-c962e0909316 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:39.067763 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d5ad1fea-c20b-41ba-8ba8-c962e0909316 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:39.068243 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d5ad1fea-c20b-41ba-8ba8-c962e0909316 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:39.212622 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-110b62d6-c69c-4eab-a599-1aeef3f3ee93 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 204 len: 0 microversion: 2.1 time: 0.438292 Jun 08 13:51:39.213315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 290/580] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:51:38 2022] DELETE /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:51:39.224764 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d5ad1fea-c20b-41ba-8ba8-c962e0909316 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:39.226354 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-05c1e43a-0e8b-42e9-9a17-98dc4cd7cba1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:39.227072 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-05c1e43a-0e8b-42e9-9a17-98dc4cd7cba1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:39.233422 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-05c1e43a-0e8b-42e9-9a17-98dc4cd7cba1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:39.236240 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d5ad1fea-c20b-41ba-8ba8-c962e0909316 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.178645 Jun 08 13:51:39.236356 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-05c1e43a-0e8b-42e9-9a17-98dc4cd7cba1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:39.236473 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 291/581] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:39 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:39.236589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-05c1e43a-0e8b-42e9-9a17-98dc4cd7cba1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:39.236589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-05c1e43a-0e8b-42e9-9a17-98dc4cd7cba1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:39.383753 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-05c1e43a-0e8b-42e9-9a17-98dc4cd7cba1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:39.392473 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-05c1e43a-0e8b-42e9-9a17-98dc4cd7cba1 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1506 microversion: 2.1 time: 0.170471 Jun 08 13:51:39.393320 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 291/582] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:39 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:39.917697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d4c24e63-8869-4ee0-8bd0-bdedbd744a8e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:39.918320 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d4c24e63-8869-4ee0-8bd0-bdedbd744a8e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:39.926077 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d4c24e63-8869-4ee0-8bd0-bdedbd744a8e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:39.926525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d4c24e63-8869-4ee0-8bd0-bdedbd744a8e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:39.927401 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d4c24e63-8869-4ee0-8bd0-bdedbd744a8e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:39.927949 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d4c24e63-8869-4ee0-8bd0-bdedbd744a8e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:40.071171 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d4c24e63-8869-4ee0-8bd0-bdedbd744a8e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:40.079184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d4c24e63-8869-4ee0-8bd0-bdedbd744a8e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.165493 Jun 08 13:51:40.079749 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 292/583] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:39 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:40.251181 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4bad4018-2b31-4f2f-8746-8c0cc045b4d5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:40.252137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4bad4018-2b31-4f2f-8746-8c0cc045b4d5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:40.258563 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4bad4018-2b31-4f2f-8746-8c0cc045b4d5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:40.259011 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4bad4018-2b31-4f2f-8746-8c0cc045b4d5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:40.260009 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4bad4018-2b31-4f2f-8746-8c0cc045b4d5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:40.260534 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4bad4018-2b31-4f2f-8746-8c0cc045b4d5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:40.401691 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4bad4018-2b31-4f2f-8746-8c0cc045b4d5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:40.410812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5f017449-1401-4143-8b07-45050c286a2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:40.411427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5f017449-1401-4143-8b07-45050c286a2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:40.411736 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4bad4018-2b31-4f2f-8746-8c0cc045b4d5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.164902 Jun 08 13:51:40.412346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 292/584] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:40 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:40.417531 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5f017449-1401-4143-8b07-45050c286a2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:40.417980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5f017449-1401-4143-8b07-45050c286a2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:40.418750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5f017449-1401-4143-8b07-45050c286a2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:40.419184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5f017449-1401-4143-8b07-45050c286a2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:40.553094 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5f017449-1401-4143-8b07-45050c286a2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:40.560728 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5f017449-1401-4143-8b07-45050c286a2f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1506 microversion: 2.1 time: 0.154503 Jun 08 13:51:40.561322 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 293/585] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:40 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:40.877582 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 13:51:40.877803 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Wed Jun 8 13:51:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 13:51:41.096983 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b9753b0f-6a8c-4607-8d69-1774f5b8542f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:41.097859 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b9753b0f-6a8c-4607-8d69-1774f5b8542f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:41.105559 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b9753b0f-6a8c-4607-8d69-1774f5b8542f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:41.106087 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b9753b0f-6a8c-4607-8d69-1774f5b8542f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:41.106874 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b9753b0f-6a8c-4607-8d69-1774f5b8542f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:41.107316 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b9753b0f-6a8c-4607-8d69-1774f5b8542f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:41.259748 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b9753b0f-6a8c-4607-8d69-1774f5b8542f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:41.268994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b9753b0f-6a8c-4607-8d69-1774f5b8542f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.176481 Jun 08 13:51:41.269570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 293/586] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:41 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:41.428899 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1f26f41a-f014-4f93-b390-ab0c5a8aa7ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:41.429586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1f26f41a-f014-4f93-b390-ab0c5a8aa7ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:41.432033 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:41.437042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f26f41a-f014-4f93-b390-ab0c5a8aa7ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:41.437490 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f26f41a-f014-4f93-b390-ab0c5a8aa7ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:41.438470 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f26f41a-f014-4f93-b390-ab0c5a8aa7ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:41.439007 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f26f41a-f014-4f93-b390-ab0c5a8aa7ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:41.577996 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-823b1eea-c811-42b2-96d8-693a288e4c4c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:41.578639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-823b1eea-c811-42b2-96d8-693a288e4c4c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:41.582700 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1f26f41a-f014-4f93-b390-ab0c5a8aa7ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:41.585652 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-823b1eea-c811-42b2-96d8-693a288e4c4c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:41.586107 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-823b1eea-c811-42b2-96d8-693a288e4c4c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:41.586889 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-823b1eea-c811-42b2-96d8-693a288e4c4c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:41.587327 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-823b1eea-c811-42b2-96d8-693a288e4c4c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:41.590926 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1f26f41a-f014-4f93-b390-ab0c5a8aa7ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.165892 Jun 08 13:51:41.591505 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 294/587] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:41 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:41.720688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-823b1eea-c811-42b2-96d8-693a288e4c4c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:41.724311 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:41.728648 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-823b1eea-c811-42b2-96d8-693a288e4c4c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1506 microversion: 2.1 time: 0.154624 Jun 08 13:51:41.729206 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 294/588] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:41 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:42.286284 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b9f15096-54e3-4751-a830-811d6740fd10 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:42.286969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b9f15096-54e3-4751-a830-811d6740fd10 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:42.293498 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b9f15096-54e3-4751-a830-811d6740fd10 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:42.298995 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b9f15096-54e3-4751-a830-811d6740fd10 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:42.298995 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b9f15096-54e3-4751-a830-811d6740fd10 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:42.298995 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b9f15096-54e3-4751-a830-811d6740fd10 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:42.470551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b9f15096-54e3-4751-a830-811d6740fd10 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:42.476350 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-631749bf-21a1-4c56-919c-8cf7ec027831 req-b54c5a08-5e4f-4f42-8c74-985674c3c48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0eac024-11de-495f-81cd-85391caa0e2d", "name": "network-vif-deleted", "tag": "10edcea1-58b0-4fcc-a997-70b2f8d25e44"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:42.481738 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=6 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:42.484760 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b9f15096-54e3-4751-a830-811d6740fd10 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.200094 Jun 08 13:51:42.484760 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 295/589] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:42 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:42.488684 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-631749bf-21a1-4c56-919c-8cf7ec027831 req-b54c5a08-5e4f-4f42-8c74-985674c3c48b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:42.489133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-631749bf-21a1-4c56-919c-8cf7ec027831 req-b54c5a08-5e4f-4f42-8c74-985674c3c48b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:42.502603 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-631749bf-21a1-4c56-919c-8cf7ec027831 req-b54c5a08-5e4f-4f42-8c74-985674c3c48b service nova] Creating event network-vif-deleted:10edcea1-58b0-4fcc-a997-70b2f8d25e44 for instance b0eac024-11de-495f-81cd-85391caa0e2d on hv-cinder-81914 Jun 08 13:51:42.507801 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-631749bf-21a1-4c56-919c-8cf7ec027831 req-b54c5a08-5e4f-4f42-8c74-985674c3c48b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042001 Jun 08 13:51:42.508436 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 295/590] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:42.609093 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-678a9f01-df42-49f9-8439-fee656d484c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:42.609635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-678a9f01-df42-49f9-8439-fee656d484c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:42.612321 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:42.617142 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-678a9f01-df42-49f9-8439-fee656d484c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:42.617601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-678a9f01-df42-49f9-8439-fee656d484c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:42.618369 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-678a9f01-df42-49f9-8439-fee656d484c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:42.618811 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-678a9f01-df42-49f9-8439-fee656d484c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:42.746147 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b9e439dc-21a5-4c10-98d1-097b9f9cccb4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:42.751167 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b9e439dc-21a5-4c10-98d1-097b9f9cccb4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:42.755682 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b9e439dc-21a5-4c10-98d1-097b9f9cccb4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:42.756159 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b9e439dc-21a5-4c10-98d1-097b9f9cccb4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:42.760487 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b9e439dc-21a5-4c10-98d1-097b9f9cccb4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:42.761214 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b9e439dc-21a5-4c10-98d1-097b9f9cccb4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:42.765282 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-678a9f01-df42-49f9-8439-fee656d484c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:42.769489 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:42.774910 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-678a9f01-df42-49f9-8439-fee656d484c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.169641 Jun 08 13:51:42.778469 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 296/591] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:42 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:42.819677 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-48bdd86e-b454-4ea0-aa9e-2476c3e46b11 req-ea3468eb-158c-4a0c-8009-fe04281536ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff8382d-1fa6-4dbf-8c24-24e8d31e9323", "name": "network-vif-plugged", "status": "completed", "tag": "bae22dd8-6da6-4295-940a-640e10580990"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:42.828143 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-48bdd86e-b454-4ea0-aa9e-2476c3e46b11 req-ea3468eb-158c-4a0c-8009-fe04281536ec service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:42.828605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-48bdd86e-b454-4ea0-aa9e-2476c3e46b11 req-ea3468eb-158c-4a0c-8009-fe04281536ec service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:42.846707 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b9e439dc-21a5-4c10-98d1-097b9f9cccb4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:42.849533 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-48bdd86e-b454-4ea0-aa9e-2476c3e46b11 req-ea3468eb-158c-4a0c-8009-fe04281536ec service nova] Creating event network-vif-plugged:bae22dd8-6da6-4295-940a-640e10580990 for instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 on hv-cinder-81914 Jun 08 13:51:42.856425 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-48bdd86e-b454-4ea0-aa9e-2476c3e46b11 req-ea3468eb-158c-4a0c-8009-fe04281536ec service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063305 Jun 08 13:51:42.858185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b9e439dc-21a5-4c10-98d1-097b9f9cccb4 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 200 len: 1292 microversion: 2.1 time: 0.116219 Jun 08 13:51:42.861369 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 297/592] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:42.868357 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 296/593] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:42 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 1292 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:43.502840 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4c6cc22a-afd9-44e2-b860-85226abf1d35 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:43.503473 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4c6cc22a-afd9-44e2-b860-85226abf1d35 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:43.510758 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4c6cc22a-afd9-44e2-b860-85226abf1d35 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:43.511207 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4c6cc22a-afd9-44e2-b860-85226abf1d35 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:43.511994 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4c6cc22a-afd9-44e2-b860-85226abf1d35 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:43.512483 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4c6cc22a-afd9-44e2-b860-85226abf1d35 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:43.671105 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4c6cc22a-afd9-44e2-b860-85226abf1d35 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:43.679987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4c6cc22a-afd9-44e2-b860-85226abf1d35 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.183194 Jun 08 13:51:43.680945 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 298/594] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:43 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:43.793754 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8e760419-3021-457b-b1f7-ae59ea9ee2c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:43.794317 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8e760419-3021-457b-b1f7-ae59ea9ee2c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:43.802372 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e760419-3021-457b-b1f7-ae59ea9ee2c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:43.802831 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e760419-3021-457b-b1f7-ae59ea9ee2c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:43.803687 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e760419-3021-457b-b1f7-ae59ea9ee2c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:43.804076 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e760419-3021-457b-b1f7-ae59ea9ee2c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:43.875245 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:43.876532 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b0eac024-11de-495f-81cd-85391caa0e2d] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:43.884105 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:43.884572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:43.886042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:43.886491 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:43.901564 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] HTTP exception thrown: Instance b0eac024-11de-495f-81cd-85391caa0e2d could not be found. Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Request method failure captured: Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d HTTP/1.1 Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKhWmfjOgbqK2CSJHSTKHI6IveJnrM8w8UarJX_JvlVysiZhXg0V18KvvGG7aQd3UMsLFAxPtqLUvG2Maio6jvXsfWlGOgxowjEe9EDmba_uZYDLft_fZhEENfYo3NaDrW-mUQ0ZlWIC2i-YGG46CWiTxjeCvMUZ7p4mPis_UMDRHL8 Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:51:43.903543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9abd79bc99784c3f81991d1cae37a074", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}] Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 85e0d647620a407cbe03d83c86111f3d Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance b0eac024-11de-495f-81cd-85391caa0e2d could not be found. Jun 08 13:51:43.905301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'b0eac024-11de-495f-81cd-85391caa0e2d'} Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0eac024-11de-495f-81cd-85391caa0e2d could not be found. Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:51:43.906148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0eac024-11de-495f-81cd-85391caa0e2d could not be found. Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0eac024-11de-495f-81cd-85391caa0e2d could not be found. Jun 08 13:51:43.908379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:43.910061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Returning 404 to user: Instance b0eac024-11de-495f-81cd-85391caa0e2d could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:51:43.910061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-dc1f67f4-0c49-4cd7-a8e1-4795325dec3c tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d" status: 404 len: 111 microversion: 2.1 time: 0.034211 Jun 08 13:51:43.910061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 299/595] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:43 2022] GET /compute/v2.1/servers/b0eac024-11de-495f-81cd-85391caa0e2d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 13:51:43.916337 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1f827f7d-446c-473e-96ea-9c9c3b370e36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:43.917311 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1f827f7d-446c-473e-96ea-9c9c3b370e36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:43.927524 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f827f7d-446c-473e-96ea-9c9c3b370e36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:43.928093 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f827f7d-446c-473e-96ea-9c9c3b370e36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:43.928953 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f827f7d-446c-473e-96ea-9c9c3b370e36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:43.929541 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1f827f7d-446c-473e-96ea-9c9c3b370e36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:43.951762 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8e760419-3021-457b-b1f7-ae59ea9ee2c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:43.958839 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1f827f7d-446c-473e-96ea-9c9c3b370e36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:51:43.960095 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8e760419-3021-457b-b1f7-ae59ea9ee2c7 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.170298 Jun 08 13:51:43.960658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 297/596] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:43 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:44.256942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1f827f7d-446c-473e-96ea-9c9c3b370e36 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 204 len: 0 microversion: 2.1 time: 0.344013 Jun 08 13:51:44.257527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 300/597] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:51:43 2022] DELETE /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:51:44.270748 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-73d585e6-6b71-42e4-b940-93a911058a6b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:44.271387 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-73d585e6-6b71-42e4-b940-93a911058a6b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:44.273585 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:44.278369 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-73d585e6-6b71-42e4-b940-93a911058a6b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:44.278819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-73d585e6-6b71-42e4-b940-93a911058a6b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:44.279583 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-73d585e6-6b71-42e4-b940-93a911058a6b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:44.280073 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-73d585e6-6b71-42e4-b940-93a911058a6b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:44.420020 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-73d585e6-6b71-42e4-b940-93a911058a6b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:44.428110 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-73d585e6-6b71-42e4-b940-93a911058a6b tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.161519 Jun 08 13:51:44.428698 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 298/598] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:44 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:44.697893 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-655fb28d-7e27-47a8-8ef6-3dc48fabbf69 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:44.698524 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-655fb28d-7e27-47a8-8ef6-3dc48fabbf69 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:44.706335 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-655fb28d-7e27-47a8-8ef6-3dc48fabbf69 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:44.706833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-655fb28d-7e27-47a8-8ef6-3dc48fabbf69 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:44.707721 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-655fb28d-7e27-47a8-8ef6-3dc48fabbf69 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:44.708170 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-655fb28d-7e27-47a8-8ef6-3dc48fabbf69 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:44.871028 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-655fb28d-7e27-47a8-8ef6-3dc48fabbf69 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:44.879153 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-655fb28d-7e27-47a8-8ef6-3dc48fabbf69 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.185647 Jun 08 13:51:44.879702 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 301/599] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:44 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:44.979830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c6b6ee25-876e-43a8-9186-e0d8beee1850 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:44.980728 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c6b6ee25-876e-43a8-9186-e0d8beee1850 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:44.988555 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c6b6ee25-876e-43a8-9186-e0d8beee1850 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:44.989009 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c6b6ee25-876e-43a8-9186-e0d8beee1850 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:44.989789 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c6b6ee25-876e-43a8-9186-e0d8beee1850 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:44.990233 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c6b6ee25-876e-43a8-9186-e0d8beee1850 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:45.125718 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c6b6ee25-876e-43a8-9186-e0d8beee1850 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:45.133128 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c6b6ee25-876e-43a8-9186-e0d8beee1850 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.159783 Jun 08 13:51:45.133695 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 299/600] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:44 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:45.445605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c82d6591-ed27-4eef-8d47-ff4eddd6468f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:45.446225 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c82d6591-ed27-4eef-8d47-ff4eddd6468f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:45.448267 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=10 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:51:45.453103 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c82d6591-ed27-4eef-8d47-ff4eddd6468f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:45.453611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c82d6591-ed27-4eef-8d47-ff4eddd6468f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:45.462060 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c82d6591-ed27-4eef-8d47-ff4eddd6468f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:45.462060 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c82d6591-ed27-4eef-8d47-ff4eddd6468f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:45.592908 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c82d6591-ed27-4eef-8d47-ff4eddd6468f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:45.601604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c82d6591-ed27-4eef-8d47-ff4eddd6468f tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.160062 Jun 08 13:51:45.602197 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 302/601] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:45 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:45.896511 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-45ed9db9-ffe2-44d4-a314-9189c86cbfe6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:45.897133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-45ed9db9-ffe2-44d4-a314-9189c86cbfe6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:45.903204 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45ed9db9-ffe2-44d4-a314-9189c86cbfe6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:45.903656 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45ed9db9-ffe2-44d4-a314-9189c86cbfe6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:45.904454 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45ed9db9-ffe2-44d4-a314-9189c86cbfe6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:45.904899 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-45ed9db9-ffe2-44d4-a314-9189c86cbfe6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:46.052139 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-45ed9db9-ffe2-44d4-a314-9189c86cbfe6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:46.059900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-45ed9db9-ffe2-44d4-a314-9189c86cbfe6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.167512 Jun 08 13:51:46.060641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 300/602] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:45 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:46.150748 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-93a7b9f0-e10a-43e4-917b-8af5890456b9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:46.151371 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-93a7b9f0-e10a-43e4-917b-8af5890456b9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:46.158693 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-93a7b9f0-e10a-43e4-917b-8af5890456b9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:46.159147 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-93a7b9f0-e10a-43e4-917b-8af5890456b9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:46.159915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-93a7b9f0-e10a-43e4-917b-8af5890456b9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:46.160392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-93a7b9f0-e10a-43e4-917b-8af5890456b9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:46.294125 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-93a7b9f0-e10a-43e4-917b-8af5890456b9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:46.302211 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-93a7b9f0-e10a-43e4-917b-8af5890456b9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.155369 Jun 08 13:51:46.302772 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 303/603] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:46 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:46.620031 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e62b863f-f0bc-4d3c-b027-ba4c159c5de5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:46.620671 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e62b863f-f0bc-4d3c-b027-ba4c159c5de5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:46.628373 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e62b863f-f0bc-4d3c-b027-ba4c159c5de5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:46.628940 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e62b863f-f0bc-4d3c-b027-ba4c159c5de5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:46.629757 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e62b863f-f0bc-4d3c-b027-ba4c159c5de5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:46.630203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e62b863f-f0bc-4d3c-b027-ba4c159c5de5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:46.762862 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e62b863f-f0bc-4d3c-b027-ba4c159c5de5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:46.771481 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e62b863f-f0bc-4d3c-b027-ba4c159c5de5 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.155450 Jun 08 13:51:46.772044 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 301/604] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:46 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:47.078382 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-779dcb63-40b1-49ef-9838-ceb2d090783f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:47.079647 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-779dcb63-40b1-49ef-9838-ceb2d090783f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:47.085733 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-779dcb63-40b1-49ef-9838-ceb2d090783f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:47.086186 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-779dcb63-40b1-49ef-9838-ceb2d090783f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:47.086962 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-779dcb63-40b1-49ef-9838-ceb2d090783f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:47.087402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-779dcb63-40b1-49ef-9838-ceb2d090783f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:47.236728 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-779dcb63-40b1-49ef-9838-ceb2d090783f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:47.244615 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-779dcb63-40b1-49ef-9838-ceb2d090783f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.170134 Jun 08 13:51:47.245173 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 304/605] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:47 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:47.373071 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6e025f3b-9d13-4bd5-bdab-104eebf9ea8e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:47.373793 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6e025f3b-9d13-4bd5-bdab-104eebf9ea8e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:47.380258 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6e025f3b-9d13-4bd5-bdab-104eebf9ea8e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:47.380710 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6e025f3b-9d13-4bd5-bdab-104eebf9ea8e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:47.381490 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6e025f3b-9d13-4bd5-bdab-104eebf9ea8e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:47.381981 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6e025f3b-9d13-4bd5-bdab-104eebf9ea8e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:47.513221 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6e025f3b-9d13-4bd5-bdab-104eebf9ea8e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:47.521449 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6e025f3b-9d13-4bd5-bdab-104eebf9ea8e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1362 microversion: 2.1 time: 0.206336 Jun 08 13:51:47.522016 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 302/606] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:47 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:47.788918 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ca82f6d2-e25a-47fd-812b-5c5e16c59b82 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:47.789539 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ca82f6d2-e25a-47fd-812b-5c5e16c59b82 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:47.795666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ca82f6d2-e25a-47fd-812b-5c5e16c59b82 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:47.796150 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ca82f6d2-e25a-47fd-812b-5c5e16c59b82 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:47.796936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ca82f6d2-e25a-47fd-812b-5c5e16c59b82 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:47.798169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ca82f6d2-e25a-47fd-812b-5c5e16c59b82 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:47.929712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ca82f6d2-e25a-47fd-812b-5c5e16c59b82 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:47.937553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ca82f6d2-e25a-47fd-812b-5c5e16c59b82 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1521 microversion: 2.1 time: 0.152553 Jun 08 13:51:47.938182 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 305/607] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:47 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:48.262130 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2a911a1d-b9a3-439d-b303-74dc68d47c67 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:48.263023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2a911a1d-b9a3-439d-b303-74dc68d47c67 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:48.269568 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a911a1d-b9a3-439d-b303-74dc68d47c67 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:48.270023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a911a1d-b9a3-439d-b303-74dc68d47c67 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:48.270938 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a911a1d-b9a3-439d-b303-74dc68d47c67 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:48.271433 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a911a1d-b9a3-439d-b303-74dc68d47c67 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:48.423893 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2a911a1d-b9a3-439d-b303-74dc68d47c67 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:48.432874 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2a911a1d-b9a3-439d-b303-74dc68d47c67 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.174578 Jun 08 13:51:48.443446 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 303/608] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:48 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:48.537944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1e8fb0ba-f2d8-4dcc-8c75-13fbd7f386f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:48.538566 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1e8fb0ba-f2d8-4dcc-8c75-13fbd7f386f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:48.545315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e8fb0ba-f2d8-4dcc-8c75-13fbd7f386f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:48.545759 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e8fb0ba-f2d8-4dcc-8c75-13fbd7f386f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:48.546527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e8fb0ba-f2d8-4dcc-8c75-13fbd7f386f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:48.546963 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e8fb0ba-f2d8-4dcc-8c75-13fbd7f386f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:48.688768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1e8fb0ba-f2d8-4dcc-8c75-13fbd7f386f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:48.697401 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1e8fb0ba-f2d8-4dcc-8c75-13fbd7f386f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1547 microversion: 2.1 time: 0.163189 Jun 08 13:51:48.698676 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 306/609] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:48 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:48.719104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-89280c2e-0209-4397-a975-6f98b505f79c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:48.719727 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-89280c2e-0209-4397-a975-6f98b505f79c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:48.726356 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-89280c2e-0209-4397-a975-6f98b505f79c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:48.726788 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-89280c2e-0209-4397-a975-6f98b505f79c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:48.727591 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-89280c2e-0209-4397-a975-6f98b505f79c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:48.728032 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-89280c2e-0209-4397-a975-6f98b505f79c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:48.736045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-bb73f4f1-4344-4bd3-b0d6-574977bb7ab9 req-d974e863-8d56-4d56-ad50-a288a5a3b33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ff0599-d152-4940-9811-f1187ab922e0", "name": "network-vif-deleted", "tag": "a043c6d6-d4b4-4d25-927f-f3ba0a63e491"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:48.745129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-bb73f4f1-4344-4bd3-b0d6-574977bb7ab9 req-d974e863-8d56-4d56-ad50-a288a5a3b33c service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:48.745585 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-bb73f4f1-4344-4bd3-b0d6-574977bb7ab9 req-d974e863-8d56-4d56-ad50-a288a5a3b33c service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:48.758149 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-bb73f4f1-4344-4bd3-b0d6-574977bb7ab9 req-d974e863-8d56-4d56-ad50-a288a5a3b33c service nova] Creating event network-vif-deleted:a043c6d6-d4b4-4d25-927f-f3ba0a63e491 for instance b6ff0599-d152-4940-9811-f1187ab922e0 on hv-cinder-81914 Jun 08 13:51:48.763521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-bb73f4f1-4344-4bd3-b0d6-574977bb7ab9 req-d974e863-8d56-4d56-ad50-a288a5a3b33c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031894 Jun 08 13:51:48.764584 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 307/610] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:48.809067 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-89280c2e-0209-4397-a975-6f98b505f79c tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093882 Jun 08 13:51:48.809855 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 304/611] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 8 13:51:48 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:48.956574 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-05ed3934-4c37-4d87-9607-f270e8709fca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:48.957341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-05ed3934-4c37-4d87-9607-f270e8709fca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:48.964030 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-05ed3934-4c37-4d87-9607-f270e8709fca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:48.964509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-05ed3934-4c37-4d87-9607-f270e8709fca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:48.965508 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-05ed3934-4c37-4d87-9607-f270e8709fca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:48.965950 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-05ed3934-4c37-4d87-9607-f270e8709fca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:49.121681 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-05ed3934-4c37-4d87-9607-f270e8709fca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85e0d647620a407cbe03d83c86111f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abd79bc99784c3f81991d1cae37a074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:49.130301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-05ed3934-4c37-4d87-9607-f270e8709fca tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 200 len: 1306 microversion: 2.1 time: 0.179194 Jun 08 13:51:49.131200 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 308/612] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:48 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 1306 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:49.451649 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e881fe8c-d719-4a0b-9906-468baffe5d40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:49.453001 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e881fe8c-d719-4a0b-9906-468baffe5d40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:49.460108 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e881fe8c-d719-4a0b-9906-468baffe5d40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:49.460620 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e881fe8c-d719-4a0b-9906-468baffe5d40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:49.461393 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e881fe8c-d719-4a0b-9906-468baffe5d40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:49.461904 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e881fe8c-d719-4a0b-9906-468baffe5d40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:49.660948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e881fe8c-d719-4a0b-9906-468baffe5d40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:49.668943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e881fe8c-d719-4a0b-9906-468baffe5d40 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1757 microversion: 2.1 time: 0.221920 Jun 08 13:51:49.669513 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 305/613] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:49 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:50.149749 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:50.150833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] [instance: b6ff0599-d152-4940-9811-f1187ab922e0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:50.157634 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-dc2c625e-95fc-40c7-a661-f3e08c6336b8 req-edcfdd32-6f96-4343-8ec4-8a9823cabbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff8382d-1fa6-4dbf-8c24-24e8d31e9323", "tag": "bae22dd8-6da6-4295-940a-640e10580990"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:50.166846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-dc2c625e-95fc-40c7-a661-f3e08c6336b8 req-edcfdd32-6f96-4343-8ec4-8a9823cabbe0 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:50.167318 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-dc2c625e-95fc-40c7-a661-f3e08c6336b8 req-edcfdd32-6f96-4343-8ec4-8a9823cabbe0 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:50.169188 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:50.173509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:50.174452 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:50.175009 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:50.180251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-dc2c625e-95fc-40c7-a661-f3e08c6336b8 req-edcfdd32-6f96-4343-8ec4-8a9823cabbe0 service nova] Creating event network-changed:bae22dd8-6da6-4295-940a-640e10580990 for instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 on hv-cinder-81914 Jun 08 13:51:50.185355 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-dc2c625e-95fc-40c7-a661-f3e08c6336b8 req-edcfdd32-6f96-4343-8ec4-8a9823cabbe0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032368 Jun 08 13:51:50.186374 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 306/614] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:51:50.191505 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] HTTP exception thrown: Instance b6ff0599-d152-4940-9811-f1187ab922e0 could not be found. Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Request method failure captured: Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 HTTP/1.1 Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKhWmfjOgbqK2CSJHSTKHI6IveJnrM8w8UarJX_JvlVysiZhXg0V18KvvGG7aQd3UMsLFAxPtqLUvG2Maio6jvXsfWlGOgxowjEe9EDmba_uZYDLft_fZhEENfYo3NaDrW-mUQ0ZlWIC2i-YGG46CWiTxjeCvMUZ7p4mPis_UMDRHL8 Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:51:50.191858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9abd79bc99784c3f81991d1cae37a074", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9abd79bc99784c3f81991d1cae37a074"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9abd79bc99784c3f81991d1cae37a074"}]}] Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9abd79bc99784c3f81991d1cae37a074 Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-457872781 Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 85e0d647620a407cbe03d83c86111f3d Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-457872781-project Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance b6ff0599-d152-4940-9811-f1187ab922e0 could not be found. Jun 08 13:51:50.193373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'b6ff0599-d152-4940-9811-f1187ab922e0'} Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ff0599-d152-4940-9811-f1187ab922e0 could not be found. Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:51:50.194169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ff0599-d152-4940-9811-f1187ab922e0 could not be found. Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ff0599-d152-4940-9811-f1187ab922e0 could not be found. Jun 08 13:51:50.195554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:51:50.199833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] Returning 404 to user: Instance b6ff0599-d152-4940-9811-f1187ab922e0 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:51:50.199833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6d5cab7d-3955-42fe-9bef-1513152c5477 tempest-ServerRescueNegativeTestJSON-457872781 tempest-ServerRescueNegativeTestJSON-457872781-project] 10.222.0.55 "GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0" status: 404 len: 111 microversion: 2.1 time: 0.049420 Jun 08 13:51:50.199833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 309/615] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:50 2022] GET /compute/v2.1/servers/b6ff0599-d152-4940-9811-f1187ab922e0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:51:50.687337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5852d459-8e43-41a0-8fcd-d96e5c2aa961 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:50.689248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5852d459-8e43-41a0-8fcd-d96e5c2aa961 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:50.695790 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5852d459-8e43-41a0-8fcd-d96e5c2aa961 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:50.696477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5852d459-8e43-41a0-8fcd-d96e5c2aa961 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:50.697415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5852d459-8e43-41a0-8fcd-d96e5c2aa961 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:50.698019 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5852d459-8e43-41a0-8fcd-d96e5c2aa961 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:50.949439 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5852d459-8e43-41a0-8fcd-d96e5c2aa961 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:50.957753 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5852d459-8e43-41a0-8fcd-d96e5c2aa961 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1760 microversion: 2.1 time: 0.275160 Jun 08 13:51:50.958331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 307/616] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:50 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1760 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:55.533364 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1420822563", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1972270106", "security_groups": [{"name": "tempest-secgroup-smoke-1251976601"}], "networks": [{"uuid": "825cb388-149d-48df-81a0-0e0450f2f381"}], "block_device_mapping_v2": [{"uuid": "bad90c00-5c03-4aed-bcc9-edbaafb2ec07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:55.651904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] validate_networks() for [('825cb388-149d-48df-81a0-0e0450f2f381', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:51:56.028136 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:51:56.028570 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:51:56.029156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:51:56.031819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:51:56.031819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:51:56.039783 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:56.040274 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:56.041114 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:56.041563 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:56.058282 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Getting quotas for project 708bec67bbb748b382b82cd0da768d5c. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:51:56.062254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Getting quotas for user 24e3c65a8b344e4e893c3ebf436ac660 and project 708bec67bbb748b382b82cd0da768d5c. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:51:56.130329 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:51:56.132501 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bad90c00-5c03-4aed-bcc9-edbaafb2ec07',volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:51:56.258291 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-721d4fdd-e91d-48b0-8a4d-d86150de404f tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Action: 'create', calling method: .version_select at 0x7fe2894b8ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1205127874"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:56.511593 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-03d65109-6340-4416-80b6-52b0e995f4d6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.982970 Jun 08 13:51:56.512263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 310/617] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:51:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:51:56.522000 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bb72e2f0-1825-4280-87a7-d286cc800beb tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:56.522610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bb72e2f0-1825-4280-87a7-d286cc800beb tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:56.578963 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bb72e2f0-1825-4280-87a7-d286cc800beb tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:56.591555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bb72e2f0-1825-4280-87a7-d286cc800beb tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1089 microversion: 2.1 time: 0.067978 Jun 08 13:51:56.591555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 311/618] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:56 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:57.047704 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-721d4fdd-e91d-48b0-8a4d-d86150de404f tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.902140 Jun 08 13:51:57.048374 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 308/619] 10.222.0.55 () {60 vars in 1154 bytes} [Wed Jun 8 13:51:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 904 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 08 13:51:57.059401 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ed956391-164b-4596-b057-ec873099dd73 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe2896ae280>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:57.109733 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ed956391-164b-4596-b057-ec873099dd73 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14" status: 200 len: 345 microversion: 2.1 time: 0.054014 Jun 08 13:51:57.116123 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 312/620] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:51:57 2022] GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:57.604219 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b8d9dcf2-8978-4b7c-be8a-e0ac0ab49d70 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:57.604902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b8d9dcf2-8978-4b7c-be8a-e0ac0ab49d70 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:57.658258 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b8d9dcf2-8978-4b7c-be8a-e0ac0ab49d70 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:57.665017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b8d9dcf2-8978-4b7c-be8a-e0ac0ab49d70 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1089 microversion: 2.1 time: 0.065181 Jun 08 13:51:57.665644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 309/621] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:57 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:51:58.122931 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e887c9d8-649e-4152-8cf3-9234bf0d3226 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe289689a60>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:58.169930 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e887c9d8-649e-4152-8cf3-9234bf0d3226 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14" status: 200 len: 346 microversion: 2.1 time: 0.051276 Jun 08 13:51:58.170471 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 313/622] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:51:58 2022] GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:58.182020 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6bac082f-5645-46a6-a1e4-21219af01322 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Action: 'create', calling method: .version_select at 0x7fe2894c1670>, body: {"snapshot": {"volume_id": "63824bd5-8420-462a-bc9d-5a8b01741e14", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1980872703"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:51:58.613733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6bac082f-5645-46a6-a1e4-21219af01322 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.435433 Jun 08 13:51:58.614348 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 310/623] 10.222.0.55 () {60 vars in 1161 bytes} [Wed Jun 8 13:51:58 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:58.627207 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-00492329-e7b6-419c-b7f3-d28df77675c0 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe289718dc0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:58.659624 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-00492329-e7b6-419c-b7f3-d28df77675c0 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789" status: 200 len: 287 microversion: 2.1 time: 0.036211 Jun 08 13:51:58.660241 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 314/624] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 8 13:51:58 2022] GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:58.669784 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3948bb31-acbb-490a-a58a-07febe84ce52 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe289699550>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:58.681927 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-38a87eaf-973c-4d56-88bb-424408258609 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:58.682540 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-38a87eaf-973c-4d56-88bb-424408258609 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:58.688875 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38a87eaf-973c-4d56-88bb-424408258609 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:58.689330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38a87eaf-973c-4d56-88bb-424408258609 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:58.690105 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38a87eaf-973c-4d56-88bb-424408258609 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:58.690541 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38a87eaf-973c-4d56-88bb-424408258609 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:58.700776 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3948bb31-acbb-490a-a58a-07febe84ce52 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034675 Jun 08 13:51:58.703702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 311/625] 10.222.0.55 () {58 vars in 1139 bytes} [Wed Jun 8 13:51:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:58.711611 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3a1262f5-89ea-4a0a-bbf6-00687d42d06e tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe289479310>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:58.743334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3a1262f5-89ea-4a0a-bbf6-00687d42d06e tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789" status: 200 len: 287 microversion: 2.1 time: 0.035229 Jun 08 13:51:58.747574 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 312/626] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 8 13:51:58 2022] GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:58.754969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-38a87eaf-973c-4d56-88bb-424408258609 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:58.762440 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-38a87eaf-973c-4d56-88bb-424408258609 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1187 microversion: 2.1 time: 0.084358 Jun 08 13:51:58.763001 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 315/627] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:58 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:51:59.755990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5958201c-cd2c-4380-acc5-97913f9ca101 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe289699820>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:59.784941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3c467c3d-16a7-4892-a4d8-758dc5957a3d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:51:59.785655 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3c467c3d-16a7-4892-a4d8-758dc5957a3d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:51:59.786745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5958201c-cd2c-4380-acc5-97913f9ca101 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789" status: 200 len: 287 microversion: 2.1 time: 0.035276 Jun 08 13:51:59.787418 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 313/628] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 8 13:51:59 2022] GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:51:59.792354 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3c467c3d-16a7-4892-a4d8-758dc5957a3d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:59.792803 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3c467c3d-16a7-4892-a4d8-758dc5957a3d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:59.793573 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3c467c3d-16a7-4892-a4d8-758dc5957a3d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:51:59.798713 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3c467c3d-16a7-4892-a4d8-758dc5957a3d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:51:59.858008 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3c467c3d-16a7-4892-a4d8-758dc5957a3d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:51:59.865779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3c467c3d-16a7-4892-a4d8-758dc5957a3d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1195 microversion: 2.1 time: 0.086215 Jun 08 13:51:59.866647 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 316/629] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:51:59 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1195 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:52:00.800007 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8e11c23c-1854-485b-bd1e-9b0cb2667e2d tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe2894d2d30>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:00.829632 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8e11c23c-1854-485b-bd1e-9b0cb2667e2d tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789" status: 200 len: 287 microversion: 2.1 time: 0.034864 Jun 08 13:52:00.830206 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 314/630] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 8 13:52:00 2022] GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:00.883056 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1af55ec7-775b-4cb1-9a69-2e00c42545d2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:00.883663 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1af55ec7-775b-4cb1-9a69-2e00c42545d2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:00.890093 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1af55ec7-775b-4cb1-9a69-2e00c42545d2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:00.891196 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1af55ec7-775b-4cb1-9a69-2e00c42545d2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:00.892077 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1af55ec7-775b-4cb1-9a69-2e00c42545d2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:00.892521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1af55ec7-775b-4cb1-9a69-2e00c42545d2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:00.951861 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1af55ec7-775b-4cb1-9a69-2e00c42545d2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:00.959676 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1af55ec7-775b-4cb1-9a69-2e00c42545d2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1205 microversion: 2.1 time: 0.080446 Jun 08 13:52:00.960266 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 317/631] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:00 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1205 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:01.838278 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=68 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:01.842925 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4e0a0719-e114-483d-9c58-9c3656440546 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe2894798b0>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:01.873441 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4e0a0719-e114-483d-9c58-9c3656440546 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789" status: 200 len: 287 microversion: 2.1 time: 0.035890 Jun 08 13:52:01.874337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 315/632] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 8 13:52:01 2022] GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:01.977870 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d7f07f58-d94e-465a-87a1-19453bf20be1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:01.978420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d7f07f58-d94e-465a-87a1-19453bf20be1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:01.985091 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d7f07f58-d94e-465a-87a1-19453bf20be1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:01.985547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d7f07f58-d94e-465a-87a1-19453bf20be1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:01.986335 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d7f07f58-d94e-465a-87a1-19453bf20be1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:01.986956 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d7f07f58-d94e-465a-87a1-19453bf20be1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:02.048423 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d7f07f58-d94e-465a-87a1-19453bf20be1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:02.056064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d7f07f58-d94e-465a-87a1-19453bf20be1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1205 microversion: 2.1 time: 0.082143 Jun 08 13:52:02.056648 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 318/633] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:01 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1205 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:02.886503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-da308672-92c5-4b46-b385-403cd2f4b9d9 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe289617e50>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:02.916627 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-da308672-92c5-4b46-b385-403cd2f4b9d9 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789" status: 200 len: 288 microversion: 2.1 time: 0.034748 Jun 08 13:52:02.917214 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 316/634] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 8 13:52:02 2022] GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:02.927469 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c851c82f-2a5c-4849-a32c-59a84638cd85 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe2894ce550>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:03.039987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c851c82f-2a5c-4849-a32c-59a84638cd85 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789" status: 202 len: 0 microversion: 2.1 time: 0.116197 Jun 08 13:52:03.044111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 319/635] 10.222.0.55 () {58 vars in 1253 bytes} [Wed Jun 8 13:52:02 2022] DELETE /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:52:03.050206 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cadafcbd-643a-41c1-81ff-8139b59e54c8 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe289699820>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:03.080638 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e7d166a4-7b7f-4af9-b428-211eba79d1ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:03.080638 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e7d166a4-7b7f-4af9-b428-211eba79d1ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:03.081415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7d166a4-7b7f-4af9-b428-211eba79d1ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:03.082261 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7d166a4-7b7f-4af9-b428-211eba79d1ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:03.083552 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7d166a4-7b7f-4af9-b428-211eba79d1ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:03.084369 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e7d166a4-7b7f-4af9-b428-211eba79d1ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:03.088081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:03.091146 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-cadafcbd-643a-41c1-81ff-8139b59e54c8 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789" status: 200 len: 287 microversion: 2.1 time: 0.045698 Jun 08 13:52:03.091707 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 317/636] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 8 13:52:03 2022] GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:03.247401 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e7d166a4-7b7f-4af9-b428-211eba79d1ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:03.255728 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e7d166a4-7b7f-4af9-b428-211eba79d1ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.185546 Jun 08 13:52:03.256611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 320/637] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:03 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:03.365149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-bc563245-0a82-4ae2-9948-18371a152ae9 req-4ab05332-007c-4e1b-a54a-18264faf9640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c573f844-d6af-4615-8cc2-191728d83c45", "tag": "512f7b9f-3fb2-4819-b91a-7b166b591feb"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:03.377907 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-bc563245-0a82-4ae2-9948-18371a152ae9 req-4ab05332-007c-4e1b-a54a-18264faf9640 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:03.378364 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-bc563245-0a82-4ae2-9948-18371a152ae9 req-4ab05332-007c-4e1b-a54a-18264faf9640 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:03.392226 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-bc563245-0a82-4ae2-9948-18371a152ae9 req-4ab05332-007c-4e1b-a54a-18264faf9640 service nova] Creating event network-changed:512f7b9f-3fb2-4819-b91a-7b166b591feb for instance c573f844-d6af-4615-8cc2-191728d83c45 on hv-cinder-81914 Jun 08 13:52:03.396983 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-bc563245-0a82-4ae2-9948-18371a152ae9 req-4ab05332-007c-4e1b-a54a-18264faf9640 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036036 Jun 08 13:52:03.400302 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 318/638] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:04.102918 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8c7d5b11-ea81-4487-8f12-22d98db432c6 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe2894cedc0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:04.128329 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-8c7d5b11-ea81-4487-8f12-22d98db432c6 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] HTTP exception thrown: Snapshot b591abcb-651a-4fe0-8fbd-f92e76c75789 could not be found. Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8c7d5b11-ea81-4487-8f12-22d98db432c6 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Request method failure captured: Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 HTTP/1.1 Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKl8zTV5rgKJZDkm9YsL_fwNhCP4rivFtIZmCmwkh-MwQVcS1g0BQH2zeU8ee0b8gcov82Bj4Qp0MZzeFRb1f1KLPsmMkLz6i0vspu8SyltvyFkUxunMhfM0cfzZC_jrG-kzsr38M5t44PyVqTKmXOF2RODeWSslNjFz5Bbpkb3DJ9s Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: b189cf9d8f6448738a8976aa0e9a9390 Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:52:04.130697 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b189cf9d8f6448738a8976aa0e9a9390"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b189cf9d8f6448738a8976aa0e9a9390", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b189cf9d8f6448738a8976aa0e9a9390"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b189cf9d8f6448738a8976aa0e9a9390"}]}] Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: b189cf9d8f6448738a8976aa0e9a9390 Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-VolumesSnapshotsTestJSON-624555862-project Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 0eaccaa0ecf646e4bafa27867860c173 Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-624555862-project Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Snapshot b591abcb-651a-4fe0-8fbd-f92e76c75789 could not be found. Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'b591abcb-651a-4fe0-8fbd-f92e76c75789'} Jun 08 13:52:04.132384 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b591abcb-651a-4fe0-8fbd-f92e76c75789 could not be found. (HTTP 404) (Request-ID: req-feeafbce-1061-4a05-bfbd-52d158c0abcc) Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:04.133360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:52:04.134605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b591abcb-651a-4fe0-8fbd-f92e76c75789 could not be found. Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 08 13:52:04.135915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b591abcb-651a-4fe0-8fbd-f92e76c75789 could not be found. Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b591abcb-651a-4fe0-8fbd-f92e76c75789 could not be found. Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8c7d5b11-ea81-4487-8f12-22d98db432c6 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Returning 404 to user: Snapshot b591abcb-651a-4fe0-8fbd-f92e76c75789 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8c7d5b11-ea81-4487-8f12-22d98db432c6 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789" status: 404 len: 111 microversion: 2.1 time: 0.033208 Jun 08 13:52:04.137355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 321/639] 10.222.0.55 () {58 vars in 1250 bytes} [Wed Jun 8 13:52:04 2022] GET /compute/v2.1/os-snapshots/b591abcb-651a-4fe0-8fbd-f92e76c75789 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:52:04.142576 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8f61ecdb-babc-434b-aad6-e711ff7b246b tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe289617160>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:04.275157 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bdc3a766-c8cc-4ecf-86c4-5b44c4c1dc0a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:04.276643 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bdc3a766-c8cc-4ecf-86c4-5b44c4c1dc0a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:04.283184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bdc3a766-c8cc-4ecf-86c4-5b44c4c1dc0a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:04.283627 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bdc3a766-c8cc-4ecf-86c4-5b44c4c1dc0a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:04.284419 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bdc3a766-c8cc-4ecf-86c4-5b44c4c1dc0a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:04.284854 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bdc3a766-c8cc-4ecf-86c4-5b44c4c1dc0a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:04.417132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bdc3a766-c8cc-4ecf-86c4-5b44c4c1dc0a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:04.425834 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bdc3a766-c8cc-4ecf-86c4-5b44c4c1dc0a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.155048 Jun 08 13:52:04.426405 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 322/640] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:04 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:52:04.455950 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8f61ecdb-babc-434b-aad6-e711ff7b246b tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14" status: 202 len: 0 microversion: 2.1 time: 0.318414 Jun 08 13:52:04.456569 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 319/641] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:52:04 2022] DELETE /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:52:04.464566 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-807308ac-129e-4566-8228-e44e10336a7d tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe2895e8670>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:04.511854 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-807308ac-129e-4566-8228-e44e10336a7d tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14" status: 200 len: 345 microversion: 2.1 time: 0.051110 Jun 08 13:52:04.512472 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 323/642] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:52:04 2022] GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:05.443816 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e4e2acfa-82f6-4376-89d8-05b1a7ba0f47 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:05.444576 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e4e2acfa-82f6-4376-89d8-05b1a7ba0f47 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:05.451259 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e4e2acfa-82f6-4376-89d8-05b1a7ba0f47 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:05.451703 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e4e2acfa-82f6-4376-89d8-05b1a7ba0f47 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:05.452506 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e4e2acfa-82f6-4376-89d8-05b1a7ba0f47 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:05.453236 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e4e2acfa-82f6-4376-89d8-05b1a7ba0f47 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:05.526012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c29ca66a-37cb-45d7-ae37-1fc932d88589 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe28958de50>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:05.554620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-c29ca66a-37cb-45d7-ae37-1fc932d88589 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] HTTP exception thrown: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c29ca66a-37cb-45d7-ae37-1fc932d88589 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Request method failure captured: Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 HTTP/1.1 Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKl8zTV5rgKJZDkm9YsL_fwNhCP4rivFtIZmCmwkh-MwQVcS1g0BQH2zeU8ee0b8gcov82Bj4Qp0MZzeFRb1f1KLPsmMkLz6i0vspu8SyltvyFkUxunMhfM0cfzZC_jrG-kzsr38M5t44PyVqTKmXOF2RODeWSslNjFz5Bbpkb3DJ9s Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: b189cf9d8f6448738a8976aa0e9a9390 Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:52:05.556712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b189cf9d8f6448738a8976aa0e9a9390"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b189cf9d8f6448738a8976aa0e9a9390", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b189cf9d8f6448738a8976aa0e9a9390"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b189cf9d8f6448738a8976aa0e9a9390"}]}] Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: b189cf9d8f6448738a8976aa0e9a9390 Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-VolumesSnapshotsTestJSON-624555862-project Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 0eaccaa0ecf646e4bafa27867860c173 Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-624555862-project Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '63824bd5-8420-462a-bc9d-5a8b01741e14'} Jun 08 13:52:05.558118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. (HTTP 404) (Request-ID: req-2e1a13b3-16f4-4363-a205-43168f1efcdd) Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:05.559052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:52:05.560706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 08 13:52:05.562755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c29ca66a-37cb-45d7-ae37-1fc932d88589 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Returning 404 to user: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c29ca66a-37cb-45d7-ae37-1fc932d88589 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14" status: 404 len: 109 microversion: 2.1 time: 0.038017 Jun 08 13:52:05.563944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 324/643] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:52:05 2022] GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 13:52:05.571015 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4c798446-9e15-4c0c-9b68-4124a0d96241 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe28958de50>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:05.595175 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e4e2acfa-82f6-4376-89d8-05b1a7ba0f47 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:05.599593 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-4c798446-9e15-4c0c-9b68-4124a0d96241 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] HTTP exception thrown: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4c798446-9e15-4c0c-9b68-4124a0d96241 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Request method failure captured: Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: DELETE /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 HTTP/1.1 Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKl8zTV5rgKJZDkm9YsL_fwNhCP4rivFtIZmCmwkh-MwQVcS1g0BQH2zeU8ee0b8gcov82Bj4Qp0MZzeFRb1f1KLPsmMkLz6i0vspu8SyltvyFkUxunMhfM0cfzZC_jrG-kzsr38M5t44PyVqTKmXOF2RODeWSslNjFz5Bbpkb3DJ9s Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: b189cf9d8f6448738a8976aa0e9a9390 Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:52:05.601581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b189cf9d8f6448738a8976aa0e9a9390"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b189cf9d8f6448738a8976aa0e9a9390", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b189cf9d8f6448738a8976aa0e9a9390"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b189cf9d8f6448738a8976aa0e9a9390"}]}] Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: b189cf9d8f6448738a8976aa0e9a9390 Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-VolumesSnapshotsTestJSON-624555862-project Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 0eaccaa0ecf646e4bafa27867860c173 Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-624555862-project Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '63824bd5-8420-462a-bc9d-5a8b01741e14'} Jun 08 13:52:05.603226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. (HTTP 404) (Request-ID: req-7a3d0695-c802-4967-b4bf-4382f9d646c5) Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:05.604154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 08 13:52:05.605518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 08 13:52:05.606913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4c798446-9e15-4c0c-9b68-4124a0d96241 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Returning 404 to user: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:52:05.608281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4c798446-9e15-4c0c-9b68-4124a0d96241 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14" status: 404 len: 109 microversion: 2.1 time: 0.036771 Jun 08 13:52:05.610052 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e4e2acfa-82f6-4376-89d8-05b1a7ba0f47 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.163626 Jun 08 13:52:05.610052 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 320/644] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:05 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:05.614541 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 325/645] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:52:05 2022] DELETE /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:52:05.624369 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c588811f-5ed7-4154-8f71-6a517bf1aa42 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Calling method '.version_select at 0x7fe289617160>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:05.654401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-c588811f-5ed7-4154-8f71-6a517bf1aa42 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] HTTP exception thrown: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c588811f-5ed7-4154-8f71-6a517bf1aa42 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Request method failure captured: Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 HTTP/1.1 Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKl8zTV5rgKJZDkm9YsL_fwNhCP4rivFtIZmCmwkh-MwQVcS1g0BQH2zeU8ee0b8gcov82Bj4Qp0MZzeFRb1f1KLPsmMkLz6i0vspu8SyltvyFkUxunMhfM0cfzZC_jrG-kzsr38M5t44PyVqTKmXOF2RODeWSslNjFz5Bbpkb3DJ9s Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: b189cf9d8f6448738a8976aa0e9a9390 Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:52:05.657155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b189cf9d8f6448738a8976aa0e9a9390"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b189cf9d8f6448738a8976aa0e9a9390", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b189cf9d8f6448738a8976aa0e9a9390"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b189cf9d8f6448738a8976aa0e9a9390"}]}] Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: b189cf9d8f6448738a8976aa0e9a9390 Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-624555862 Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-VolumesSnapshotsTestJSON-624555862-project Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 0eaccaa0ecf646e4bafa27867860c173 Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-VolumesSnapshotsTestJSON-624555862-project Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '63824bd5-8420-462a-bc9d-5a8b01741e14'} Jun 08 13:52:05.658692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. (HTTP 404) (Request-ID: req-262d7755-2748-4e97-b459-6b2e75f7c131) Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:05.659641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:52:05.661065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 08 13:52:05.662399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c588811f-5ed7-4154-8f71-6a517bf1aa42 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] Returning 404 to user: Volume 63824bd5-8420-462a-bc9d-5a8b01741e14 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c588811f-5ed7-4154-8f71-6a517bf1aa42 tempest-VolumesSnapshotsTestJSON-624555862 tempest-VolumesSnapshotsTestJSON-624555862-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14" status: 404 len: 109 microversion: 2.1 time: 0.038138 Jun 08 13:52:05.663641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 321/646] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:52:05 2022] GET /compute/v2.1/os-volumes/63824bd5-8420-462a-bc9d-5a8b01741e14 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:52:06.618574 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:06.619982 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=8 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:06.623846 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-83f110d2-bea7-49db-babf-479f202dfc29 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:06.625046 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-83f110d2-bea7-49db-babf-479f202dfc29 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:06.631546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-83f110d2-bea7-49db-babf-479f202dfc29 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:06.632003 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-83f110d2-bea7-49db-babf-479f202dfc29 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:06.632813 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-83f110d2-bea7-49db-babf-479f202dfc29 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:06.633251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-83f110d2-bea7-49db-babf-479f202dfc29 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:06.800810 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-83f110d2-bea7-49db-babf-479f202dfc29 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:06.813692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-83f110d2-bea7-49db-babf-479f202dfc29 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.190583 Jun 08 13:52:06.813692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 326/647] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:06 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:07.746188 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:07.826294 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f1f74cfc-4661-434a-9015-b54f4cdd7bac tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:07.826962 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f1f74cfc-4661-434a-9015-b54f4cdd7bac tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:07.834127 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1f74cfc-4661-434a-9015-b54f4cdd7bac tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:07.834578 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1f74cfc-4661-434a-9015-b54f4cdd7bac tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:07.835383 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1f74cfc-4661-434a-9015-b54f4cdd7bac tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:07.835820 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1f74cfc-4661-434a-9015-b54f4cdd7bac tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:07.868628 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ef7b4ce1-d413-4352-bb93-cdd00b7c8d04 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] Action: 'create', calling method: .version_select at 0x7fe289699940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-343471006", "metadata": {"Type": "work"}}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:07.976018 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f1f74cfc-4661-434a-9015-b54f4cdd7bac tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:07.983789 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f1f74cfc-4661-434a-9015-b54f4cdd7bac tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.161330 Jun 08 13:52:07.984502 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 327/648] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:07 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:52:08.616594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ef7b4ce1-d413-4352-bb93-cdd00b7c8d04 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.868866 Jun 08 13:52:08.616594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 322/649] 10.222.0.55 () {60 vars in 1155 bytes} [Wed Jun 8 13:52:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 870 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 08 13:52:08.625675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9c159fb0-f018-48f2-9fce-162a41ea115b tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] Calling method '.version_select at 0x7fe2897184c0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:08.673658 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9c159fb0-f018-48f2-9fce-162a41ea115b tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba" status: 200 len: 352 microversion: 2.1 time: 0.052150 Jun 08 13:52:08.674240 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 328/650] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:52:08 2022] GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:09.001811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7ca8b377-b799-4267-b609-834f6d604773 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:09.002438 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7ca8b377-b799-4267-b609-834f6d604773 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:09.008635 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7ca8b377-b799-4267-b609-834f6d604773 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:09.009087 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7ca8b377-b799-4267-b609-834f6d604773 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:09.009850 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7ca8b377-b799-4267-b609-834f6d604773 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:09.010288 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7ca8b377-b799-4267-b609-834f6d604773 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:09.140583 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7ca8b377-b799-4267-b609-834f6d604773 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:09.147964 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7ca8b377-b799-4267-b609-834f6d604773 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.150981 Jun 08 13:52:09.153088 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 323/651] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:08 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:09.685858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9ef3c272-e9c1-485b-adb6-a7665defbdf5 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] Calling method '.version_select at 0x7fe2897addc0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:09.732481 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9ef3c272-e9c1-485b-adb6-a7665defbdf5 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba" status: 200 len: 353 microversion: 2.1 time: 0.050787 Jun 08 13:52:09.733162 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 329/652] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:52:09 2022] GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:09.744738 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d69479d4-3430-4e2b-a4c8-9e3846c2de70 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] Calling method '.version_select at 0x7fe2894c1430>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:09.798026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d69479d4-3430-4e2b-a4c8-9e3846c2de70 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba" status: 200 len: 353 microversion: 2.1 time: 0.057483 Jun 08 13:52:09.798631 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 324/653] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:52:09 2022] GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:09.814327 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bc065219-866c-4d09-9274-2d29578e5c8c tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] Calling method '.version_select at 0x7fe289706a60>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:10.010202 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bc065219-866c-4d09-9274-2d29578e5c8c tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba" status: 202 len: 0 microversion: 2.1 time: 0.199688 Jun 08 13:52:10.010777 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 330/654] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:52:09 2022] DELETE /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:52:10.022345 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4907f6f9-7f40-413c-a790-d29faf5f3a24 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] Calling method '.version_select at 0x7fe2895c98b0>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:10.072953 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4907f6f9-7f40-413c-a790-d29faf5f3a24 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba" status: 200 len: 352 microversion: 2.1 time: 0.057726 Jun 08 13:52:10.073527 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 325/655] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:52:10 2022] GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:10.165681 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-cc04322a-dd24-4397-98e8-ce80127cc504 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:10.166329 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-cc04322a-dd24-4397-98e8-ce80127cc504 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:10.172610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cc04322a-dd24-4397-98e8-ce80127cc504 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:10.173066 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cc04322a-dd24-4397-98e8-ce80127cc504 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:10.173832 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cc04322a-dd24-4397-98e8-ce80127cc504 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:10.174271 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cc04322a-dd24-4397-98e8-ce80127cc504 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:10.307486 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-cc04322a-dd24-4397-98e8-ce80127cc504 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:10.309720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-55be8f9a-1ab3-44e3-90e9-936c481f0898 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:10.310191 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-55be8f9a-1ab3-44e3-90e9-936c481f0898 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:10.316043 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-cc04322a-dd24-4397-98e8-ce80127cc504 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.153977 Jun 08 13:52:10.316731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 331/656] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:10 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:10.317086 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55be8f9a-1ab3-44e3-90e9-936c481f0898 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:10.317533 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55be8f9a-1ab3-44e3-90e9-936c481f0898 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:10.318297 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55be8f9a-1ab3-44e3-90e9-936c481f0898 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:10.318730 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55be8f9a-1ab3-44e3-90e9-936c481f0898 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:10.341618 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-55be8f9a-1ab3-44e3-90e9-936c481f0898 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/ips" status: 200 len: 149 microversion: 2.20 time: 0.139213 Jun 08 13:52:10.342167 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 326/657] 10.222.0.55 () {60 vars in 1288 bytes} [Wed Jun 8 13:52:10 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/ips => generated 149 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 08 13:52:11.089787 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-96be916b-107e-40fe-a1a6-40eab506eb27 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] Calling method '.version_select at 0x7fe289706280>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:11.119901 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-96be916b-107e-40fe-a1a6-40eab506eb27 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] HTTP exception thrown: Volume ab725659-2153-415f-9c20-00aa111944ba could not be found. Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-96be916b-107e-40fe-a1a6-40eab506eb27 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] Request method failure captured: Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba HTTP/1.1 Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKmHyF9gOh3GRTds_k8dsTR5AuCrAanI7DiggH1_OBN1Jw8pIhwRT1gap-3F6Y4g8ic74LkWA7DT5ULadIY4-8pqC684xYfViA_Qf6eczNhyg-cJiyvzyTNCDYbhjf7JZvH1ttTOJvR2W3eZ7T4zHB7QMRiZpe06gg9pXWAuZhi1RTw Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: d66abc5c3a744f5d81c7b64c147dac88 Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-VolumesGetTestJSON-899444884 Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:52:11.121888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d66abc5c3a744f5d81c7b64c147dac88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d66abc5c3a744f5d81c7b64c147dac88", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d66abc5c3a744f5d81c7b64c147dac88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d66abc5c3a744f5d81c7b64c147dac88"}]}] Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-VolumesGetTestJSON-899444884 Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: d66abc5c3a744f5d81c7b64c147dac88 Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-VolumesGetTestJSON-899444884 Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-VolumesGetTestJSON-899444884-project Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 9b6da373016c440ebe2dbd6d51ca2ec3 Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-VolumesGetTestJSON-899444884-project Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Volume ab725659-2153-415f-9c20-00aa111944ba could not be found. Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'ab725659-2153-415f-9c20-00aa111944ba'} Jun 08 13:52:11.124912 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab725659-2153-415f-9c20-00aa111944ba could not be found. (HTTP 404) (Request-ID: req-4e364574-536e-4fbb-a1fb-9d3efb01deb0) Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:11.125895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 08 13:52:11.127500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab725659-2153-415f-9c20-00aa111944ba could not be found. Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 08 13:52:11.128837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab725659-2153-415f-9c20-00aa111944ba could not be found. Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab725659-2153-415f-9c20-00aa111944ba could not be found. Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-96be916b-107e-40fe-a1a6-40eab506eb27 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] Returning 404 to user: Volume ab725659-2153-415f-9c20-00aa111944ba could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-96be916b-107e-40fe-a1a6-40eab506eb27 tempest-VolumesGetTestJSON-899444884 tempest-VolumesGetTestJSON-899444884-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba" status: 404 len: 109 microversion: 2.1 time: 0.037582 Jun 08 13:52:11.130620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 332/658] 10.222.0.55 () {58 vars in 1244 bytes} [Wed Jun 8 13:52:11 2022] GET /compute/v2.1/os-volumes/ab725659-2153-415f-9c20-00aa111944ba => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:52:11.333940 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a01d49be-b0b6-44ab-8a31-7f7169b2975d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:11.334575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a01d49be-b0b6-44ab-8a31-7f7169b2975d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:11.341100 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a01d49be-b0b6-44ab-8a31-7f7169b2975d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:11.341558 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a01d49be-b0b6-44ab-8a31-7f7169b2975d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:11.342323 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a01d49be-b0b6-44ab-8a31-7f7169b2975d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:11.342766 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a01d49be-b0b6-44ab-8a31-7f7169b2975d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:11.479723 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a01d49be-b0b6-44ab-8a31-7f7169b2975d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:11.487368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a01d49be-b0b6-44ab-8a31-7f7169b2975d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.157272 Jun 08 13:52:11.487936 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 327/659] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:11 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:12.431961 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1d14fb2d-fae3-47fc-9217-441a76ebe431 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:12.432558 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1d14fb2d-fae3-47fc-9217-441a76ebe431 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:12.439621 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1d14fb2d-fae3-47fc-9217-441a76ebe431 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:12.440090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1d14fb2d-fae3-47fc-9217-441a76ebe431 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:12.440863 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1d14fb2d-fae3-47fc-9217-441a76ebe431 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:12.441302 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1d14fb2d-fae3-47fc-9217-441a76ebe431 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:12.463501 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-1d14fb2d-fae3-47fc-9217-441a76ebe431 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lazy-loading 'flavor' on Instance uuid dab28955-49eb-4750-839f-b9f2b14cb299 {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:52:12.504380 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-786f3df1-237c-4817-8115-610f6c935f31 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:12.504995 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-786f3df1-237c-4817-8115-610f6c935f31 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:12.511730 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-786f3df1-237c-4817-8115-610f6c935f31 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:12.512216 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-786f3df1-237c-4817-8115-610f6c935f31 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:12.512989 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-786f3df1-237c-4817-8115-610f6c935f31 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:12.513419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-786f3df1-237c-4817-8115-610f6c935f31 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:12.648519 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-786f3df1-237c-4817-8115-610f6c935f31 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:12.657173 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-786f3df1-237c-4817-8115-610f6c935f31 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.156480 Jun 08 13:52:12.657757 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 328/660] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:12 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:13.073421 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1d14fb2d-fae3-47fc-9217-441a76ebe431 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/action" status: 202 len: 0 microversion: 2.20 time: 0.645607 Jun 08 13:52:13.074119 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 333/661] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 8 13:52:12 2022] POST /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:52:13.082702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:13.083314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:13.090093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:13.090545 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:13.091324 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:13.091938 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:13.234732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:13.244026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:13.245735 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:13.246949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-926b8dec-ad20-4937-84b0-eec7a04ac2e0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.168426 Jun 08 13:52:13.247597 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 329/662] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:13 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:13.674451 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6d89da70-2d1d-43c1-8f9e-7b6af85bd4d5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:13.675150 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6d89da70-2d1d-43c1-8f9e-7b6af85bd4d5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:13.681759 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6d89da70-2d1d-43c1-8f9e-7b6af85bd4d5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:13.682051 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6d89da70-2d1d-43c1-8f9e-7b6af85bd4d5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:13.682819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6d89da70-2d1d-43c1-8f9e-7b6af85bd4d5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:13.683247 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6d89da70-2d1d-43c1-8f9e-7b6af85bd4d5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:13.818493 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6d89da70-2d1d-43c1-8f9e-7b6af85bd4d5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:13.825945 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6d89da70-2d1d-43c1-8f9e-7b6af85bd4d5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.156415 Jun 08 13:52:13.826540 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 334/663] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:13 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:14.266928 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:14.267543 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:14.274144 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:14.274606 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:14.275372 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:14.275810 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:14.404683 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:14.412701 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:14.414166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:14.415315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-03920b49-afb1-4205-b222-0b8470c11bc9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.153250 Jun 08 13:52:14.415869 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 330/664] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:14 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:14.844466 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2db9098f-3bf3-4f39-817b-3d74237cdf24 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:14.845432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2db9098f-3bf3-4f39-817b-3d74237cdf24 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:14.849102 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:14.853191 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2db9098f-3bf3-4f39-817b-3d74237cdf24 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:14.853638 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2db9098f-3bf3-4f39-817b-3d74237cdf24 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:14.854405 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2db9098f-3bf3-4f39-817b-3d74237cdf24 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:14.854838 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2db9098f-3bf3-4f39-817b-3d74237cdf24 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:14.881422 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-8ef93d02-dd76-4523-a1dc-a14bddc1f6a1 req-761819d4-accc-4e8d-a35d-ff77a49c0d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c573f844-d6af-4615-8cc2-191728d83c45", "name": "network-vif-plugged", "status": "completed", "tag": "512f7b9f-3fb2-4819-b91a-7b166b591feb"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:14.902765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-8ef93d02-dd76-4523-a1dc-a14bddc1f6a1 req-761819d4-accc-4e8d-a35d-ff77a49c0d19 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:14.903217 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-8ef93d02-dd76-4523-a1dc-a14bddc1f6a1 req-761819d4-accc-4e8d-a35d-ff77a49c0d19 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:14.915149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-8ef93d02-dd76-4523-a1dc-a14bddc1f6a1 req-761819d4-accc-4e8d-a35d-ff77a49c0d19 service nova] Creating event network-vif-plugged:512f7b9f-3fb2-4819-b91a-7b166b591feb for instance c573f844-d6af-4615-8cc2-191728d83c45 on hv-cinder-81914 Jun 08 13:52:14.921555 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-8ef93d02-dd76-4523-a1dc-a14bddc1f6a1 req-761819d4-accc-4e8d-a35d-ff77a49c0d19 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044369 Jun 08 13:52:14.922399 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 331/665] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:52:15.017823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2db9098f-3bf3-4f39-817b-3d74237cdf24 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:15.025726 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2db9098f-3bf3-4f39-817b-3d74237cdf24 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.186142 Jun 08 13:52:15.026322 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 335/666] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:14 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:52:15.435194 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:15.435885 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:15.438502 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=42 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:15.443372 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:15.443868 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:15.444637 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:15.445068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:15.575552 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:15.584080 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:15.585648 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:15.586788 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ee54d839-a4c5-4b0a-861d-00e7c2f6c3a2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.156280 Jun 08 13:52:15.587346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 332/667] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:15 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:16.042825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2da39356-483f-4cc5-9e86-0ffa4f999b7e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:16.043437 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2da39356-483f-4cc5-9e86-0ffa4f999b7e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:16.050397 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2da39356-483f-4cc5-9e86-0ffa4f999b7e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:16.050839 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2da39356-483f-4cc5-9e86-0ffa4f999b7e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:16.051604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2da39356-483f-4cc5-9e86-0ffa4f999b7e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:16.052245 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2da39356-483f-4cc5-9e86-0ffa4f999b7e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:16.190368 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2da39356-483f-4cc5-9e86-0ffa4f999b7e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:16.197928 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2da39356-483f-4cc5-9e86-0ffa4f999b7e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1261 microversion: 2.1 time: 0.159015 Jun 08 13:52:16.198482 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 336/668] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:16 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:16.609865 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:16.609865 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:16.613667 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:16.614211 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:16.615054 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:16.615562 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:16.747189 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:16.756522 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:16.760645 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:16.760645 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8fb8ae52-2aea-4def-88a9-694097122ddb tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.157450 Jun 08 13:52:16.760645 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 333/669] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:16 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:17.215689 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0ca09bc5-9893-40f4-b757-b59ea6b07059 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:17.216335 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0ca09bc5-9893-40f4-b757-b59ea6b07059 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:17.224006 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0ca09bc5-9893-40f4-b757-b59ea6b07059 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:17.224491 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0ca09bc5-9893-40f4-b757-b59ea6b07059 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:17.225261 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0ca09bc5-9893-40f4-b757-b59ea6b07059 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:17.225702 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0ca09bc5-9893-40f4-b757-b59ea6b07059 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:17.357143 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0ca09bc5-9893-40f4-b757-b59ea6b07059 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:17.364752 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0ca09bc5-9893-40f4-b757-b59ea6b07059 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1444 microversion: 2.1 time: 0.153024 Jun 08 13:52:17.365383 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 337/670] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:17 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:17.380742 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ca48c690-7723-436e-991a-af711f58334d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:17.381485 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ca48c690-7723-436e-991a-af711f58334d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:17.387691 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ca48c690-7723-436e-991a-af711f58334d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:17.388179 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ca48c690-7723-436e-991a-af711f58334d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:17.388975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ca48c690-7723-436e-991a-af711f58334d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:17.389935 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ca48c690-7723-436e-991a-af711f58334d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:17.516217 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ca48c690-7723-436e-991a-af711f58334d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:17.523664 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ca48c690-7723-436e-991a-af711f58334d tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1444 microversion: 2.1 time: 0.146767 Jun 08 13:52:17.524255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 334/671] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:17 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:17.777369 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:17.777980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:17.784350 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:17.784795 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:17.785553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:17.785987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:17.991302 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:17.999286 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:18.000831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:18.001996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d98774b0-43b5-4c36-95ce-0a7890fcf4ba tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.228512 Jun 08 13:52:18.002736 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 338/672] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:17 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:19.020948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:19.021512 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:19.028592 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:19.029054 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:19.029848 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:19.030544 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:19.388604 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:19.397428 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:19.398988 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:19.400264 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bb3939fd-3e60-4dd3-81a7-8b64add00aa2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.383451 Jun 08 13:52:19.400841 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 335/673] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:19 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:20.195320 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-6d7d1cee-acba-4cc8-b994-4b17f0ef90be req-60355475-a22d-406c-b8a8-c3f4fbcba1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c573f844-d6af-4615-8cc2-191728d83c45", "tag": "512f7b9f-3fb2-4819-b91a-7b166b591feb"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:20.203422 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-6d7d1cee-acba-4cc8-b994-4b17f0ef90be req-60355475-a22d-406c-b8a8-c3f4fbcba1a4 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:20.203858 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-6d7d1cee-acba-4cc8-b994-4b17f0ef90be req-60355475-a22d-406c-b8a8-c3f4fbcba1a4 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:20.214956 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-6d7d1cee-acba-4cc8-b994-4b17f0ef90be req-60355475-a22d-406c-b8a8-c3f4fbcba1a4 service nova] Creating event network-changed:512f7b9f-3fb2-4819-b91a-7b166b591feb for instance c573f844-d6af-4615-8cc2-191728d83c45 on hv-cinder-81914 Jun 08 13:52:20.220489 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-6d7d1cee-acba-4cc8-b994-4b17f0ef90be req-60355475-a22d-406c-b8a8-c3f4fbcba1a4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153672 Jun 08 13:52:20.221372 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 339/674] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:20.419166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:20.419767 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:20.426728 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:20.427220 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:20.427919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:20.428377 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:20.558388 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:20.567094 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:20.568645 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:20.569814 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-97f29873-675c-432a-8506-ef6cd444c6a5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.154578 Jun 08 13:52:20.570381 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 336/675] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:20 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:21.589363 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:21.590072 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:21.597361 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:21.597849 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:21.598623 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:21.599064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:21.739113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:21.747392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:21.749155 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:21.750605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-44c6d2d6-10a7-48b0-be77-d1c401d6ff19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.166040 Jun 08 13:52:21.751174 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 340/676] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:21 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:22.769114 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:22.769728 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:22.776264 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:22.777379 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:22.777481 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:22.777924 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:22.902624 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:22.911053 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:22.912603 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:22.913765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-cc6d21ff-3baf-4543-bd8d-f761142d578d tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.148603 Jun 08 13:52:22.914316 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 337/677] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:22 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:23.933804 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:23.934324 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:23.941570 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:23.942045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:23.942810 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:23.943245 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:24.077849 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:24.085671 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:24.087216 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:24.088506 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b75d92ce-65d3-4b14-a2c6-d73e28ce8f59 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.158733 Jun 08 13:52:24.089024 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 341/678] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:23 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:25.107279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:25.108376 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:25.115225 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:25.115755 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:25.116638 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:25.117085 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:25.246886 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:25.255680 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:25.257211 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:25.258355 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0ac7c308-f55a-4ebd-bf34-2e8611de0905 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.155225 Jun 08 13:52:25.258908 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 338/679] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:25 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:26.277396 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:26.278068 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:26.284930 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:26.285385 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:26.286163 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:26.286611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:26.421634 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:26.429679 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:26.431193 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:26.432401 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0781fbda-15cf-4b9c-aae8-97bba116e4c1 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.158958 Jun 08 13:52:26.432972 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 342/680] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:26 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:27.450773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:27.451975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:27.458577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:27.459035 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:27.459806 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:27.460351 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:27.610123 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:27.618035 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:27.619530 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:27.620704 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c0e08d6e-c9cb-4b18-8631-1ac6ce2d5499 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.173927 Jun 08 13:52:27.621252 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 339/681] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:27 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:27.845150 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-923aa8a0-0b7e-447e-b984-48b5631946d2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:27.845974 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-923aa8a0-0b7e-447e-b984-48b5631946d2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:27.852651 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-923aa8a0-0b7e-447e-b984-48b5631946d2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:27.853154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-923aa8a0-0b7e-447e-b984-48b5631946d2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:27.853925 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-923aa8a0-0b7e-447e-b984-48b5631946d2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:27.854368 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-923aa8a0-0b7e-447e-b984-48b5631946d2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:27.868103 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:27.877534 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-923aa8a0-0b7e-447e-b984-48b5631946d2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/ips" status: 200 len: 144 microversion: 2.1 time: 0.037066 Jun 08 13:52:27.878103 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 343/682] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:52:27 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:28.641560 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:28.642958 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:28.650961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:28.651527 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:28.652577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:28.653718 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:28.803048 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:28.812236 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:28.813817 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:28.814984 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-02ddf0af-7ee1-4e30-81b9-9017b9ab81e5 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.179904 Jun 08 13:52:28.815544 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 340/683] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:28 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:29.527046 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1068422e-bc5f-46cc-9331-69ec41d2c3e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5404582-892f-4e8f-987e-1e038037c6a9"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:29.528152 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1068422e-bc5f-46cc-9331-69ec41d2c3e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:29.535498 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1068422e-bc5f-46cc-9331-69ec41d2c3e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:29.535942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1068422e-bc5f-46cc-9331-69ec41d2c3e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:29.536733 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1068422e-bc5f-46cc-9331-69ec41d2c3e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:29.537169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1068422e-bc5f-46cc-9331-69ec41d2c3e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:29.833642 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:29.834258 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:29.840927 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:29.841385 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:29.842375 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:29.842946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:29.847164 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=100 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:29.981985 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:29.990474 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:29.991965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:29.993156 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-65936982-92d5-4973-b3df-625f37f1a46b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1742 microversion: 2.20 time: 0.163439 Jun 08 13:52:29.993720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 341/684] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:29 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:30.375601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1068422e-bc5f-46cc-9331-69ec41d2c3e3 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852339 Jun 08 13:52:30.376283 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 344/685] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:52:29 2022] POST /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:31.012913 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:31.013491 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:31.020224 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:31.023732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:31.024607 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:31.025200 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:31.194458 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:31.206270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:31.208213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:31.209764 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5dda22d8-13c9-4cbc-b744-a4b9bc9e3a04 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1742 microversion: 2.20 time: 0.201100 Jun 08 13:52:31.210640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 342/686] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:31 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1742 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:32.154346 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-42ab009d-c214-41dc-b976-a6aea45b3c0a tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1841842695"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:32.155672 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-42ab009d-c214-41dc-b976-a6aea45b3c0a tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:32.162155 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42ab009d-c214-41dc-b976-a6aea45b3c0a tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:32.162608 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42ab009d-c214-41dc-b976-a6aea45b3c0a tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:32.163383 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42ab009d-c214-41dc-b976-a6aea45b3c0a tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:32.163820 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42ab009d-c214-41dc-b976-a6aea45b3c0a tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:32.234229 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:32.235644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:32.247771 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:32.249056 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:32.249902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:32.250433 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:32.410673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.network.security_group_api [None req-42ab009d-c214-41dc-b976-a6aea45b3c0a tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Removing security group a312ba82-f39d-4542-8a23-2c668eaeafb4 from port 86e5c27b-3254-42aa-9d0f-5a43c944241b Jun 08 13:52:32.633388 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:32.643027 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:32.647959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:32.656333 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-124668a9-69d9-4098-b32d-1a165aec5eb9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.420436 Jun 08 13:52:32.656333 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 343/687] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:32 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:33.199514 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-42ab009d-c214-41dc-b976-a6aea45b3c0a tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "POST /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/action" status: 202 len: 0 microversion: 2.1 time: 1.050089 Jun 08 13:52:33.200190 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 345/688] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:52:32 2022] POST /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/action => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:52:33.228135 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-1dd2952e-b038-42b2-b46c-8b47bba36c89 req-6ac91506-f706-4f56-9775-c0cd89051fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ed7b73-7978-4c81-84f1-53d223ad842f", "tag": "86e5c27b-3254-42aa-9d0f-5a43c944241b"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:33.251360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-1dd2952e-b038-42b2-b46c-8b47bba36c89 req-6ac91506-f706-4f56-9775-c0cd89051fc2 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:33.253776 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-1dd2952e-b038-42b2-b46c-8b47bba36c89 req-6ac91506-f706-4f56-9775-c0cd89051fc2 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:33.302268 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-1dd2952e-b038-42b2-b46c-8b47bba36c89 req-6ac91506-f706-4f56-9775-c0cd89051fc2 service nova] Creating event network-changed:86e5c27b-3254-42aa-9d0f-5a43c944241b for instance 08ed7b73-7978-4c81-84f1-53d223ad842f on hv-cinder-81914 Jun 08 13:52:33.327132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-1dd2952e-b038-42b2-b46c-8b47bba36c89 req-6ac91506-f706-4f56-9775-c0cd89051fc2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103014 Jun 08 13:52:33.336958 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 346/689] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:33.565712 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-d3d8dd7c-458b-4869-8347-10fe2a489a25 req-336f488a-4daa-44cf-9d33-a3302829901e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab28955-49eb-4750-839f-b9f2b14cb299", "name": "network-vif-plugged", "status": "completed", "tag": "3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:33.575664 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-d3d8dd7c-458b-4869-8347-10fe2a489a25 req-336f488a-4daa-44cf-9d33-a3302829901e service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:33.577874 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-d3d8dd7c-458b-4869-8347-10fe2a489a25 req-336f488a-4daa-44cf-9d33-a3302829901e service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:33.596289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-d3d8dd7c-458b-4869-8347-10fe2a489a25 req-336f488a-4daa-44cf-9d33-a3302829901e service nova] Creating event network-vif-plugged:3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4 for instance dab28955-49eb-4750-839f-b9f2b14cb299 on hv-cinder-81914 Jun 08 13:52:33.604740 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-d3d8dd7c-458b-4869-8347-10fe2a489a25 req-336f488a-4daa-44cf-9d33-a3302829901e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.568501 Jun 08 13:52:33.606755 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 344/690] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:52:33.692071 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:33.694646 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:33.725083 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:33.727694 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:33.729240 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:33.730748 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:34.183262 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:34.197211 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:34.198833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:34.202621 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-39edef0e-26c7-416f-aa85-9275b0a70084 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.535860 Jun 08 13:52:34.220395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 347/691] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:33 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:35.224937 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:35.227149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:35.235384 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:35.236201 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:35.237230 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:35.237672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:35.359365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1bd591e4-39f4-49a4-b1ae-45dc20914c4e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:35.360539 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1bd591e4-39f4-49a4-b1ae-45dc20914c4e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:35.367133 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1bd591e4-39f4-49a4-b1ae-45dc20914c4e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:35.367585 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1bd591e4-39f4-49a4-b1ae-45dc20914c4e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:35.368566 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1bd591e4-39f4-49a4-b1ae-45dc20914c4e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:35.369012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1bd591e4-39f4-49a4-b1ae-45dc20914c4e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:35.437219 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:35.448168 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:35.449772 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:35.452161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3915d3e0-9c2d-4802-8cf0-53456d7cd5df tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.231687 Jun 08 13:52:35.452945 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 345/692] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:35 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:35.457628 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-8e16c51e-3336-4790-9738-7fdbd0dd17d0 req-42e1469e-7c26-4008-8a05-046e4bfae7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08ed7b73-7978-4c81-84f1-53d223ad842f", "tag": "86e5c27b-3254-42aa-9d0f-5a43c944241b"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:35.466696 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-8e16c51e-3336-4790-9738-7fdbd0dd17d0 req-42e1469e-7c26-4008-8a05-046e4bfae7b1 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:35.467655 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-8e16c51e-3336-4790-9738-7fdbd0dd17d0 req-42e1469e-7c26-4008-8a05-046e4bfae7b1 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:35.472582 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-1bd591e4-39f4-49a4-b1ae-45dc20914c4e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lazy-loading 'services' on Instance uuid 08ed7b73-7978-4c81-84f1-53d223ad842f {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:52:35.480098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-8e16c51e-3336-4790-9738-7fdbd0dd17d0 req-42e1469e-7c26-4008-8a05-046e4bfae7b1 service nova] Creating event network-changed:86e5c27b-3254-42aa-9d0f-5a43c944241b for instance 08ed7b73-7978-4c81-84f1-53d223ad842f on hv-cinder-81914 Jun 08 13:52:35.486233 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-8e16c51e-3336-4790-9738-7fdbd0dd17d0 req-42e1469e-7c26-4008-8a05-046e4bfae7b1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031888 Jun 08 13:52:35.486934 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 346/693] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:35.752991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1bd591e4-39f4-49a4-b1ae-45dc20914c4e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "DELETE /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments/57465250-b54f-4f7c-9b22-6bd074a0dab1" status: 202 len: 0 microversion: 2.1 time: 0.398761 Jun 08 13:52:35.757385 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 348/694] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:52:35 2022] DELETE /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments/57465250-b54f-4f7c-9b22-6bd074a0dab1 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:52:35.764701 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5bbbafa3-5fc7-4cbc-8cae-dcb2f31d586e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:35.766058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5bbbafa3-5fc7-4cbc-8cae-dcb2f31d586e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:35.782102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5bbbafa3-5fc7-4cbc-8cae-dcb2f31d586e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:35.782625 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5bbbafa3-5fc7-4cbc-8cae-dcb2f31d586e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:35.784890 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5bbbafa3-5fc7-4cbc-8cae-dcb2f31d586e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:35.785622 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5bbbafa3-5fc7-4cbc-8cae-dcb2f31d586e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:35.847067 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5bbbafa3-5fc7-4cbc-8cae-dcb2f31d586e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088424 Jun 08 13:52:35.856202 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 347/695] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:52:35 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:52:36.471930 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:36.473836 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:36.481531 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:36.481984 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:36.483034 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:36.483811 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:36.714776 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:36.728661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:36.728661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:36.728661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-839da951-565a-48eb-b7ad-f7d7a7af0713 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.261645 Jun 08 13:52:36.729968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 349/696] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:36 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:36.865427 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b13d46d6-3e1d-4c45-a37a-e05438288752 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:36.867558 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b13d46d6-3e1d-4c45-a37a-e05438288752 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:36.882034 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b13d46d6-3e1d-4c45-a37a-e05438288752 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:36.882761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b13d46d6-3e1d-4c45-a37a-e05438288752 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:36.883551 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b13d46d6-3e1d-4c45-a37a-e05438288752 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:36.884199 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b13d46d6-3e1d-4c45-a37a-e05438288752 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:36.917902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b13d46d6-3e1d-4c45-a37a-e05438288752 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057220 Jun 08 13:52:36.918790 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 348/697] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:52:36 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:37.748008 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:37.748926 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:37.758314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:37.759266 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:37.764310 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:37.764978 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:37.931211 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b1ca2e49-f83a-40ea-a67e-7e955cfba6e6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:37.932825 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b1ca2e49-f83a-40ea-a67e-7e955cfba6e6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:37.941257 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b1ca2e49-f83a-40ea-a67e-7e955cfba6e6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:37.942407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b1ca2e49-f83a-40ea-a67e-7e955cfba6e6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:37.943390 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b1ca2e49-f83a-40ea-a67e-7e955cfba6e6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:37.944313 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b1ca2e49-f83a-40ea-a67e-7e955cfba6e6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:37.980617 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b1ca2e49-f83a-40ea-a67e-7e955cfba6e6 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053588 Jun 08 13:52:37.985954 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 349/698] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:52:37 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:37.994962 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:38.007331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:38.010854 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:38.014303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b16ebfa9-4a5c-4aa0-9b08-2c270f19a63a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.269975 Jun 08 13:52:38.017655 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 350/699] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:37 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:38.200466 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4b4e8655-5ad5-4b86-9ea9-e625037ca518 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:38.201805 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4b4e8655-5ad5-4b86-9ea9-e625037ca518 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:38.217636 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4b4e8655-5ad5-4b86-9ea9-e625037ca518 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:38.218349 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4b4e8655-5ad5-4b86-9ea9-e625037ca518 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:38.219299 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4b4e8655-5ad5-4b86-9ea9-e625037ca518 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:38.219898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4b4e8655-5ad5-4b86-9ea9-e625037ca518 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:38.255664 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4b4e8655-5ad5-4b86-9ea9-e625037ca518 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059603 Jun 08 13:52:38.267303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5ff97eed-50ec-4c46-9c54-87f80075976e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:38.268018 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5ff97eed-50ec-4c46-9c54-87f80075976e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:38.272898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 350/700] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:52:38 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:38.276707 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5ff97eed-50ec-4c46-9c54-87f80075976e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:38.277400 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5ff97eed-50ec-4c46-9c54-87f80075976e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:38.278349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5ff97eed-50ec-4c46-9c54-87f80075976e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:38.279529 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5ff97eed-50ec-4c46-9c54-87f80075976e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:38.316330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5ff97eed-50ec-4c46-9c54-87f80075976e tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/a5404582-892f-4e8f-987e-1e038037c6a9" status: 200 len: 194 microversion: 2.1 time: 0.053658 Jun 08 13:52:38.317565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 351/701] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Jun 8 13:52:38 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/a5404582-892f-4e8f-987e-1e038037c6a9 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:38.995254 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-11c9c994-b64c-4cca-90f3-bb5902a999ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:38.996993 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-11c9c994-b64c-4cca-90f3-bb5902a999ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:39.006934 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11c9c994-b64c-4cca-90f3-bb5902a999ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:39.007387 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11c9c994-b64c-4cca-90f3-bb5902a999ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:39.008201 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11c9c994-b64c-4cca-90f3-bb5902a999ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:39.008662 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11c9c994-b64c-4cca-90f3-bb5902a999ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:39.037351 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:39.038062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:39.045379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:39.045808 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-11c9c994-b64c-4cca-90f3-bb5902a999ea tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055864 Jun 08 13:52:39.045960 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:39.046565 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 351/702] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:52:38 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:52:39.046867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:39.047527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:39.059081 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:39.059611 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:39.066715 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:39.067213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:39.068011 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:39.068480 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:39.156747 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] HTTP exception thrown: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f is not attached to volume 57465250-b54f-4f7c-9b22-6bd074a0dab1 Jun 08 13:52:39.197763 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Request method failure captured: Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: DELETE /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments/57465250-b54f-4f7c-9b22-6bd074a0dab1 HTTP/1.1 Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKj_W0Zq5V60Zflu4R_bOX4G8eAE6VvW_TGVPKdJ6iRYPCfCWswGhviQmqGU0zoWFyRFMurqszf8DNzrZ8LgszLw_iWSg5LHcP85QxzQ5EfYqa3culY8rZrhwMv_rWhD78tM8riR_Tf82ORjo2qxWlxkw7W-UZtWRUTy8XopYrypQ8E Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 14385fc22a1d4de4bc0af0c764f6ef69 Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-TestMinimumBasicScenario-1463513676 Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:52:39.205414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/14385fc22a1d4de4bc0af0c764f6ef69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_14385fc22a1d4de4bc0af0c764f6ef69", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/14385fc22a1d4de4bc0af0c764f6ef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/14385fc22a1d4de4bc0af0c764f6ef69"}]}] Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-TestMinimumBasicScenario-1463513676 Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 14385fc22a1d4de4bc0af0c764f6ef69 Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1463513676 Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-TestMinimumBasicScenario-1463513676-project Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: d6bd0d1fd6be41a3a711be3fb4c0cbfc Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-TestMinimumBasicScenario-1463513676-project Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:52:39.207778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f is not attached to volume 57465250-b54f-4f7c-9b22-6bd074a0dab1 Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'server_id': '08ed7b73-7978-4c81-84f1-53d223ad842f', 'id': '57465250-b54f-4f7c-9b22-6bd074a0dab1'} Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 57465250-b54f-4f7c-9b22-6bd074a0dab1. Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:52:39.208830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f is not attached to volume 57465250-b54f-4f7c-9b22-6bd074a0dab1 Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f is not attached to volume 57465250-b54f-4f7c-9b22-6bd074a0dab1 Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:52:39.210329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Returning 404 to user: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f is not attached to volume 57465250-b54f-4f7c-9b22-6bd074a0dab1 {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:52:39.211958 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:39.212102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-47e089c9-5230-4674-9b0b-f72bf2649b5f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "DELETE /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments/57465250-b54f-4f7c-9b22-6bd074a0dab1" status: 404 len: 154 microversion: 2.1 time: 0.152432 Jun 08 13:52:39.212102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 352/703] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:52:39 2022] DELETE /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f/os-volume_attachments/57465250-b54f-4f7c-9b22-6bd074a0dab1 => generated 154 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 13:52:39.212294 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:39.212294 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9272c6a9-80eb-4511-9d70-c74692485f64 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.178188 Jun 08 13:52:39.212517 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 352/704] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:39 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:40.238476 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:40.239023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:40.245932 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:40.246392 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:40.247205 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:40.247910 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:40.435556 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:40.445361 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:40.447301 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:40.448648 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-40add874-8844-447e-80a7-169e424f6d10 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.216381 Jun 08 13:52:40.452739 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 353/705] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:40 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:40.793358 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3e4510ed-932c-4e7d-802a-091e284a45e7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:40.793869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3e4510ed-932c-4e7d-802a-091e284a45e7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:40.803785 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3e4510ed-932c-4e7d-802a-091e284a45e7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:40.804342 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3e4510ed-932c-4e7d-802a-091e284a45e7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:40.805322 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3e4510ed-932c-4e7d-802a-091e284a45e7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:40.806059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3e4510ed-932c-4e7d-802a-091e284a45e7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:40.835036 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3e4510ed-932c-4e7d-802a-091e284a45e7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:52:41.175206 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3e4510ed-932c-4e7d-802a-091e284a45e7 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "DELETE /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 204 len: 0 microversion: 2.1 time: 0.383489 Jun 08 13:52:41.177298 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 353/706] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:52:40 2022] DELETE /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:52:41.185850 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8d4be911-315a-484b-965f-b6ce21bf3900 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:41.186584 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8d4be911-315a-484b-965f-b6ce21bf3900 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:41.198580 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8d4be911-315a-484b-965f-b6ce21bf3900 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:41.204306 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8d4be911-315a-484b-965f-b6ce21bf3900 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:41.212004 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8d4be911-315a-484b-965f-b6ce21bf3900 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:41.213097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8d4be911-315a-484b-965f-b6ce21bf3900 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:41.240273 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b7cb5297-a599-4f42-a021-ba0f219b9a61 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84eed187-9ecf-4a1a-9f92-9c791071b178"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:41.241754 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b7cb5297-a599-4f42-a021-ba0f219b9a61 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:41.249139 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b7cb5297-a599-4f42-a021-ba0f219b9a61 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:41.250111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b7cb5297-a599-4f42-a021-ba0f219b9a61 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:41.251519 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b7cb5297-a599-4f42-a021-ba0f219b9a61 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:41.252140 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b7cb5297-a599-4f42-a021-ba0f219b9a61 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:41.420337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8d4be911-315a-484b-965f-b6ce21bf3900 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:41.429986 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8d4be911-315a-484b-965f-b6ce21bf3900 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1554 microversion: 2.1 time: 0.248435 Jun 08 13:52:41.440746 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 354/707] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:41 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:41.470276 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:41.471334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:41.483301 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:41.484073 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:41.484979 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:41.485641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:41.632633 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:41.642149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:41.644043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:41.645330 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-25dd6f49-5fd2-42c2-b740-5fa135a59a0e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.182534 Jun 08 13:52:41.645890 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 355/708] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:41 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:42.447279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6ea357bb-1707-4236-b546-03202b12179f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:42.447986 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6ea357bb-1707-4236-b546-03202b12179f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:42.455662 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6ea357bb-1707-4236-b546-03202b12179f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:42.456150 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6ea357bb-1707-4236-b546-03202b12179f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:42.457102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6ea357bb-1707-4236-b546-03202b12179f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:42.457381 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6ea357bb-1707-4236-b546-03202b12179f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:42.848567 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6ea357bb-1707-4236-b546-03202b12179f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:42.856239 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6ea357bb-1707-4236-b546-03202b12179f tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1554 microversion: 2.1 time: 0.412940 Jun 08 13:52:42.856809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 356/709] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:42 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1554 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:52:42.862053 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:42.862665 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:42.869926 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:42.870388 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:42.871166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:42.871611 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:43.033013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:43.041920 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:43.043831 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:43.045825 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-657ab195-3883-43b5-8c7d-76ea9f461ddc tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.187446 Jun 08 13:52:43.046623 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 357/710] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:42 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:43.629634 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b7cb5297-a599-4f42-a021-ba0f219b9a61 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "POST /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.393677 Jun 08 13:52:43.631482 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 354/711] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:52:41 2022] POST /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments => generated 194 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:52:43.873581 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e9010a1d-8425-4302-9b2a-e940dc55a184 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:43.874407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e9010a1d-8425-4302-9b2a-e940dc55a184 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:43.885314 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e9010a1d-8425-4302-9b2a-e940dc55a184 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:43.885783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e9010a1d-8425-4302-9b2a-e940dc55a184 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:43.886611 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e9010a1d-8425-4302-9b2a-e940dc55a184 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:43.887078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e9010a1d-8425-4302-9b2a-e940dc55a184 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:44.061672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e9010a1d-8425-4302-9b2a-e940dc55a184 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:44.066320 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:44.067100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:44.070854 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e9010a1d-8425-4302-9b2a-e940dc55a184 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1554 microversion: 2.1 time: 0.201385 Jun 08 13:52:44.072743 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 358/712] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:43 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:44.073819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:44.074279 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:44.075841 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:44.075841 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:44.254414 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:44.262547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:44.264688 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:44.265829 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d5146665-ebd9-488a-8a46-436233b5b5ed tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1737 microversion: 2.20 time: 0.204710 Jun 08 13:52:44.266690 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 355/713] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:44 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:44.435708 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-863d4f7b-ba0b-4cbf-9b5b-17632bd0b52d req-27255dbd-66a3-4662-98c1-23a9fea362ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08ed7b73-7978-4c81-84f1-53d223ad842f", "name": "network-vif-deleted", "tag": "86e5c27b-3254-42aa-9d0f-5a43c944241b"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:44.443565 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-863d4f7b-ba0b-4cbf-9b5b-17632bd0b52d req-27255dbd-66a3-4662-98c1-23a9fea362ac service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:44.444000 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-863d4f7b-ba0b-4cbf-9b5b-17632bd0b52d req-27255dbd-66a3-4662-98c1-23a9fea362ac service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:44.447688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=100 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:44.455704 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-863d4f7b-ba0b-4cbf-9b5b-17632bd0b52d req-27255dbd-66a3-4662-98c1-23a9fea362ac service nova] Creating event network-vif-deleted:86e5c27b-3254-42aa-9d0f-5a43c944241b for instance 08ed7b73-7978-4c81-84f1-53d223ad842f on hv-cinder-81914 Jun 08 13:52:44.460539 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-863d4f7b-ba0b-4cbf-9b5b-17632bd0b52d req-27255dbd-66a3-4662-98c1-23a9fea362ac service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155997 Jun 08 13:52:44.461136 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 359/714] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:45.089271 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:45.089888 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:45.100365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:45.100827 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:45.101635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:45.102081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:45.117671 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:45.136427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:45.136885 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:45.137338 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lazy-loading 'fault' on Instance uuid 08ed7b73-7978-4c81-84f1-53d223ad842f {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:52:45.180676 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bd0d1fd6be41a3a711be3fb4c0cbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14385fc22a1d4de4bc0af0c764f6ef69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:45.189415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-284699ec-16a2-4dcd-8c62-7dfa2687ed46 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 200 len: 1348 microversion: 2.1 time: 0.104124 Jun 08 13:52:45.190017 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 356/715] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:45 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:52:45.291963 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:45.292696 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:45.300458 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:45.300917 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:45.301696 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:45.302138 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:45.451904 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:45.460221 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:45.461782 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:45.462992 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a2aa84a9-8794-4bce-ae5c-d81a63d73755 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1719 microversion: 2.20 time: 0.175866 Jun 08 13:52:45.463557 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 360/716] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:45 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:46.207795 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:46.208376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] [instance: 08ed7b73-7978-4c81-84f1-53d223ad842f] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:46.210593 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:46.215553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:46.216025 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:46.216938 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:46.217373 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:46.230825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] HTTP exception thrown: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f could not be found. Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Request method failure captured: Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f HTTP/1.1 Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKj_W0Zq5V60Zflu4R_bOX4G8eAE6VvW_TGVPKdJ6iRYPCfCWswGhviQmqGU0zoWFyRFMurqszf8DNzrZ8LgszLw_iWSg5LHcP85QxzQ5EfYqa3culY8rZrhwMv_rWhD78tM8riR_Tf82ORjo2qxWlxkw7W-UZtWRUTy8XopYrypQ8E Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 14385fc22a1d4de4bc0af0c764f6ef69 Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-TestMinimumBasicScenario-1463513676 Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:52:46.232542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/14385fc22a1d4de4bc0af0c764f6ef69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_14385fc22a1d4de4bc0af0c764f6ef69", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/14385fc22a1d4de4bc0af0c764f6ef69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/14385fc22a1d4de4bc0af0c764f6ef69"}]}] Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-TestMinimumBasicScenario-1463513676 Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 14385fc22a1d4de4bc0af0c764f6ef69 Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1463513676 Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-TestMinimumBasicScenario-1463513676-project Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: d6bd0d1fd6be41a3a711be3fb4c0cbfc Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-TestMinimumBasicScenario-1463513676-project Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f could not be found. Jun 08 13:52:46.234049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '08ed7b73-7978-4c81-84f1-53d223ad842f'} Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f could not be found. Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:52:46.234862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f could not be found. Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f could not be found. Jun 08 13:52:46.236183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:52:46.237279 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Returning 404 to user: Instance 08ed7b73-7978-4c81-84f1-53d223ad842f could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:52:46.237279 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-59ed8053-d352-4aac-bf41-d215ba5b631e tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f" status: 404 len: 111 microversion: 2.1 time: 0.030521 Jun 08 13:52:46.237279 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 357/717] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:52:46 2022] GET /compute/v2.1/servers/08ed7b73-7978-4c81-84f1-53d223ad842f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:52:46.242582 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7de1de73-43d8-4e89-ad26-b91279d2ec82 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] Calling method '.version_select at 0x7fe289483430>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:46.248927 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=58 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:52:46.349946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7de1de73-43d8-4e89-ad26-b91279d2ec82 tempest-TestMinimumBasicScenario-1463513676 tempest-TestMinimumBasicScenario-1463513676-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1082643024" status: 202 len: 0 microversion: 2.1 time: 0.111171 Jun 08 13:52:46.350611 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 361/718] 10.222.0.55 () {58 vars in 1271 bytes} [Wed Jun 8 13:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1082643024 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:52:46.483948 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:46.494511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:46.494511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:46.494511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:46.494511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:46.494971 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:46.627513 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:46.635810 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:46.637359 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:46.641061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e5f38a80-056b-41ff-85de-ed186af447ff tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1719 microversion: 2.20 time: 0.160007 Jun 08 13:52:46.641061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 358/719] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:46 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:47.001990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-a4b134e3-1213-4968-b11b-796353512529 req-0ac424de-4d6d-42b8-b8f6-788282d52f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab28955-49eb-4750-839f-b9f2b14cb299", "name": "network-vif-unplugged", "status": "completed", "tag": "3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:47.017159 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-a4b134e3-1213-4968-b11b-796353512529 req-0ac424de-4d6d-42b8-b8f6-788282d52f48 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:47.017159 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-a4b134e3-1213-4968-b11b-796353512529 req-0ac424de-4d6d-42b8-b8f6-788282d52f48 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:47.027844 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-a4b134e3-1213-4968-b11b-796353512529 req-0ac424de-4d6d-42b8-b8f6-788282d52f48 service nova] Creating event network-vif-unplugged:3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4 for instance dab28955-49eb-4750-839f-b9f2b14cb299 on hv-cinder-81914 Jun 08 13:52:47.033410 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-a4b134e3-1213-4968-b11b-796353512529 req-0ac424de-4d6d-42b8-b8f6-788282d52f48 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036859 Jun 08 13:52:47.034004 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 362/720] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:47.658636 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:47.659869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:47.666448 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:47.666994 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:47.667780 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:47.668427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:47.810388 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:47.819303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:47.820880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:47.822379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-23ddd94a-b19b-47f4-b191-7ba09e5fdc1b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1719 microversion: 2.20 time: 0.167614 Jun 08 13:52:47.822962 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 359/721] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:47 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:48.843255 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:48.843959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:48.850429 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:48.850886 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:48.851660 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:48.852123 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:49.029358 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:49.037161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:49.038661 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:49.039813 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-84b5bd79-ea95-4483-83e2-92c1b44d2602 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1662 microversion: 2.20 time: 0.201899 Jun 08 13:52:49.040392 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 363/722] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:48 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1662 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:49.057819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0bce4fc6-8ae7-47db-ba75-e80b1d98b445 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "039f472f-5712-4281-b8ce-5d1d02d0a002"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:49.059162 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0bce4fc6-8ae7-47db-ba75-e80b1d98b445 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:49.065876 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0bce4fc6-8ae7-47db-ba75-e80b1d98b445 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:49.066333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0bce4fc6-8ae7-47db-ba75-e80b1d98b445 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:49.067085 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0bce4fc6-8ae7-47db-ba75-e80b1d98b445 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:49.067516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0bce4fc6-8ae7-47db-ba75-e80b1d98b445 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:50.188116 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0bce4fc6-8ae7-47db-ba75-e80b1d98b445 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.134248 Jun 08 13:52:50.193886 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 360/723] 10.222.0.55 () {62 vars in 1363 bytes} [Wed Jun 8 13:52:49 2022] POST /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/os-volume_attachments => generated 188 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 08 13:52:50.307349 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2358f445-4d1e-4656-9233-47ac8df975ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:50.307879 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2358f445-4d1e-4656-9233-47ac8df975ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:50.315472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2358f445-4d1e-4656-9233-47ac8df975ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:50.315930 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2358f445-4d1e-4656-9233-47ac8df975ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:50.316737 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2358f445-4d1e-4656-9233-47ac8df975ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:50.317179 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2358f445-4d1e-4656-9233-47ac8df975ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:51.084933 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2358f445-4d1e-4656-9233-47ac8df975ef tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "DELETE /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/os-volume_attachments/039f472f-5712-4281-b8ce-5d1d02d0a002" status: 202 len: 0 microversion: 2.20 time: 0.781390 Jun 08 13:52:51.088943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 364/724] 10.222.0.55 () {60 vars in 1456 bytes} [Wed Jun 8 13:52:50 2022] DELETE /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/os-volume_attachments/039f472f-5712-4281-b8ce-5d1d02d0a002 => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:52:51.157893 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-870d68fb-a32a-427c-8a2f-63f34f4270f0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:52:51.159012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-870d68fb-a32a-427c-8a2f-63f34f4270f0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:51.173337 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-870d68fb-a32a-427c-8a2f-63f34f4270f0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:51.173988 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-870d68fb-a32a-427c-8a2f-63f34f4270f0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:51.174866 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-870d68fb-a32a-427c-8a2f-63f34f4270f0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:51.175554 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-870d68fb-a32a-427c-8a2f-63f34f4270f0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:51.422779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-870d68fb-a32a-427c-8a2f-63f34f4270f0 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "POST /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/action" status: 202 len: 0 microversion: 2.20 time: 0.270738 Jun 08 13:52:51.424526 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 361/725] 10.222.0.55 () {62 vars in 1318 bytes} [Wed Jun 8 13:52:51 2022] POST /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:52:51.432953 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:51.433568 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:51.447893 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:51.447893 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:51.448105 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:51.448688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:51.701423 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:51.718750 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:51.721202 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:51.726872 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-df5669e1-05d1-4efd-976b-33114306bcf7 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1670 microversion: 2.20 time: 0.294948 Jun 08 13:52:51.729645 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 365/726] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:51 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1670 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:52.330763 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8f892206-1db4-431a-bf6a-da26263800b0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:52.331730 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8f892206-1db4-431a-bf6a-da26263800b0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:52.337883 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8f892206-1db4-431a-bf6a-da26263800b0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:52.338400 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8f892206-1db4-431a-bf6a-da26263800b0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:52.339459 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8f892206-1db4-431a-bf6a-da26263800b0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:52.339909 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8f892206-1db4-431a-bf6a-da26263800b0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:52.380209 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8f892206-1db4-431a-bf6a-da26263800b0 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054335 Jun 08 13:52:52.381743 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 362/727] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:52:52 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:52.530783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bcb4e2b5-0217-42b4-a5df-ddcc890d655b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:52.531453 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bcb4e2b5-0217-42b4-a5df-ddcc890d655b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:52.537978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bcb4e2b5-0217-42b4-a5df-ddcc890d655b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:52.538433 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bcb4e2b5-0217-42b4-a5df-ddcc890d655b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:52.539204 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bcb4e2b5-0217-42b4-a5df-ddcc890d655b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:52.539641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bcb4e2b5-0217-42b4-a5df-ddcc890d655b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:52.583495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bcb4e2b5-0217-42b4-a5df-ddcc890d655b tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/a5404582-892f-4e8f-987e-1e038037c6a9" status: 200 len: 194 microversion: 2.1 time: 0.057402 Jun 08 13:52:52.584600 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 366/728] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Jun 8 13:52:52 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/a5404582-892f-4e8f-987e-1e038037c6a9 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:52.596513 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2b99dddc-2582-473f-8c6b-d80fa1921ea5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:52.597592 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2b99dddc-2582-473f-8c6b-d80fa1921ea5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:52.604884 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b99dddc-2582-473f-8c6b-d80fa1921ea5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:52.605461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b99dddc-2582-473f-8c6b-d80fa1921ea5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:52.606774 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b99dddc-2582-473f-8c6b-d80fa1921ea5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:52.607401 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2b99dddc-2582-473f-8c6b-d80fa1921ea5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:52.710039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-2b99dddc-2582-473f-8c6b-d80fa1921ea5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lazy-loading 'services' on Instance uuid fff8382d-1fa6-4dbf-8c24-24e8d31e9323 {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:52:52.747855 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:52.748916 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:52.756161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:52.756856 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:52.757927 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:52.758624 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:52.987799 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:52.992699 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:52.995495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:52.997478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f328db44-660f-432a-9b70-85370286485e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1670 microversion: 2.20 time: 0.254112 Jun 08 13:52:53.009104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 367/729] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:52 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1670 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:53.028088 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2b99dddc-2582-473f-8c6b-d80fa1921ea5 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/a5404582-892f-4e8f-987e-1e038037c6a9" status: 202 len: 0 microversion: 2.1 time: 0.436492 Jun 08 13:52:53.029345 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 363/730] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:52:52 2022] DELETE /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/a5404582-892f-4e8f-987e-1e038037c6a9 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:52:54.017156 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:54.017839 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:54.024632 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:54.025157 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:54.026092 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:54.026593 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:54.193221 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:54.202797 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:54.204413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:54.205724 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-833d519b-e861-4387-ba6e-358e266316ae tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.193592 Jun 08 13:52:54.206287 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 368/731] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:54 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:55.221076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e664d3f4-5212-40dc-919c-8dae7c2cd6f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:55.221656 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e664d3f4-5212-40dc-919c-8dae7c2cd6f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:55.226810 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:55.227509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:55.228803 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e664d3f4-5212-40dc-919c-8dae7c2cd6f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:55.229251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e664d3f4-5212-40dc-919c-8dae7c2cd6f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:55.230249 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e664d3f4-5212-40dc-919c-8dae7c2cd6f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:55.230688 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e664d3f4-5212-40dc-919c-8dae7c2cd6f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:55.234512 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:55.235328 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:55.236132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:55.236739 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:55.262257 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e664d3f4-5212-40dc-919c-8dae7c2cd6f6 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/84eed187-9ecf-4a1a-9f92-9c791071b178" status: 200 len: 194 microversion: 2.1 time: 0.045850 Jun 08 13:52:55.263781 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 364/732] 10.222.0.55 () {58 vars in 1412 bytes} [Wed Jun 8 13:52:55 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/84eed187-9ecf-4a1a-9f92-9c791071b178 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:52:55.273236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3097e3bc-c738-4d53-abbd-be376c3d9d02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:55.274105 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3097e3bc-c738-4d53-abbd-be376c3d9d02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:55.280509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3097e3bc-c738-4d53-abbd-be376c3d9d02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:55.281181 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3097e3bc-c738-4d53-abbd-be376c3d9d02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:55.281979 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3097e3bc-c738-4d53-abbd-be376c3d9d02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:55.282421 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3097e3bc-c738-4d53-abbd-be376c3d9d02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:55.374287 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:55.382599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-3097e3bc-c738-4d53-abbd-be376c3d9d02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lazy-loading 'services' on Instance uuid fff8382d-1fa6-4dbf-8c24-24e8d31e9323 {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:52:55.384836 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:55.390338 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:55.391782 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-78c1ab30-42eb-49d4-9c07-9e8dd310ca42 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.170039 Jun 08 13:52:55.400872 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 369/733] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:55 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:52:55.666356 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3097e3bc-c738-4d53-abbd-be376c3d9d02 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/84eed187-9ecf-4a1a-9f92-9c791071b178" status: 202 len: 0 microversion: 2.1 time: 0.396678 Jun 08 13:52:55.666953 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 365/734] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:52:55 2022] DELETE /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments/84eed187-9ecf-4a1a-9f92-9c791071b178 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 13:52:56.410607 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:56.411278 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:56.434369 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:56.442605 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:56.442605 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:56.442605 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:56.635471 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:56.648859 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:56.651845 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:56.654412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e1d0e5d3-d9f1-4064-a6ce-3a939210fabd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.247964 Jun 08 13:52:56.654984 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 370/735] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:56 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:57.674062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:57.675586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:57.682753 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:57.683319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:57.684932 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:57.685628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:57.899597 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:57.910767 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:57.914510 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:57.919347 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6cbca601-3d33-4060-852c-46624c410079 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.248388 Jun 08 13:52:57.932732 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 366/736] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:57 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:52:58.939036 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:52:58.939950 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:52:58.951151 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:58.951994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:58.953246 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:52:58.954157 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:52:59.164667 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:59.177661 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:59.180279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:52:59.182343 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-24fd229b-d951-43b0-af18-b1d652d0f040 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.247214 Jun 08 13:52:59.190739 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 371/737] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:52:58 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:53:00.204330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:00.205018 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:00.211811 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:00.212527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:00.213499 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:00.214152 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:00.358542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:00.367471 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:00.369319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:00.370710 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a79f1588-6717-4c83-92d4-80fd9cd88a98 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.170537 Jun 08 13:53:00.371495 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 367/738] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:00 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:01.391952 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:01.392566 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:01.399043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:01.399740 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:01.400761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:01.401404 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:01.544279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:01.552898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:01.554437 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:01.555623 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-93640772-62c3-48c0-8ebd-fcf94452ebd9 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.168799 Jun 08 13:53:01.567851 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 372/739] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:01 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:02.577756 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:02.579245 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:02.586288 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:02.586735 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:02.587565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:02.588025 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:02.604466 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=6,nova_cell1:UPDATE=5 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:02.732735 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:02.742546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:02.744785 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:02.746781 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-10251b34-50fa-4581-9b2b-c717d0dc25bd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.174958 Jun 08 13:53:02.758735 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 368/740] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:02 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:03.766689 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:03.768083 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:03.774859 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:03.775456 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:03.776542 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:03.777209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:03.917219 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:03.926907 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:03.928584 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:03.929743 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bd1b1b1d-90b3-40a4-be1e-a69032710746 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.167681 Jun 08 13:53:03.930486 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 373/741] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:03 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:04.950773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:04.951516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:04.959745 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:04.960389 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:04.961632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:04.962393 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:05.119936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:05.131887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:05.133478 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:05.134645 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-38e10fe8-ddbe-437d-974c-8e01be18793a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.188861 Jun 08 13:53:05.135222 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 369/742] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:04 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:06.155709 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:06.156484 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:06.163013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:06.163448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:06.164251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:06.164692 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:06.304093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:06.315420 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:06.317324 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:06.318690 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-362fe059-d8e3-431b-a356-c4d1e215917c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.167131 Jun 08 13:53:06.319269 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 374/743] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:06 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:06.480006 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f3083d9a-8588-4ccd-a9c0-33d608f2ee07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:06.481658 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f3083d9a-8588-4ccd-a9c0-33d608f2ee07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:06.488129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3083d9a-8588-4ccd-a9c0-33d608f2ee07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:06.488579 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3083d9a-8588-4ccd-a9c0-33d608f2ee07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:06.489327 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3083d9a-8588-4ccd-a9c0-33d608f2ee07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:06.489759 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3083d9a-8588-4ccd-a9c0-33d608f2ee07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:06.517887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f3083d9a-8588-4ccd-a9c0-33d608f2ee07 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041757 Jun 08 13:53:06.518435 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 370/744] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:53:06 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:53:06.622750 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-00609b0d-1415-4fcf-be1f-7bb79aab32ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:06.623746 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-00609b0d-1415-4fcf-be1f-7bb79aab32ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:06.629846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-00609b0d-1415-4fcf-be1f-7bb79aab32ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:06.630244 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-00609b0d-1415-4fcf-be1f-7bb79aab32ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:06.631012 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-00609b0d-1415-4fcf-be1f-7bb79aab32ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:06.631452 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-00609b0d-1415-4fcf-be1f-7bb79aab32ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:06.656898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:06.660947 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-00609b0d-1415-4fcf-be1f-7bb79aab32ee tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042285 Jun 08 13:53:06.661504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 375/745] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:53:06 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:53:06.724540 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2f4480ad-6324-4e6c-b982-8fe7692775b2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:06.725037 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2f4480ad-6324-4e6c-b982-8fe7692775b2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:06.731651 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f4480ad-6324-4e6c-b982-8fe7692775b2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:06.732135 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f4480ad-6324-4e6c-b982-8fe7692775b2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:06.732893 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f4480ad-6324-4e6c-b982-8fe7692775b2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:06.733325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2f4480ad-6324-4e6c-b982-8fe7692775b2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:06.757589 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2f4480ad-6324-4e6c-b982-8fe7692775b2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:53:07.022600 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2f4480ad-6324-4e6c-b982-8fe7692775b2 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 204 len: 0 microversion: 2.1 time: 0.301946 Jun 08 13:53:07.023340 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 371/746] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:53:06 2022] DELETE /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:53:07.032395 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f9e2f57f-8a42-4732-ae4a-d3e8c6d1d10f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:07.033019 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f9e2f57f-8a42-4732-ae4a-d3e8c6d1d10f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:07.039666 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9e2f57f-8a42-4732-ae4a-d3e8c6d1d10f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:07.040226 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9e2f57f-8a42-4732-ae4a-d3e8c6d1d10f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:07.040989 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9e2f57f-8a42-4732-ae4a-d3e8c6d1d10f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:07.041430 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f9e2f57f-8a42-4732-ae4a-d3e8c6d1d10f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:07.175100 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f9e2f57f-8a42-4732-ae4a-d3e8c6d1d10f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:07.182665 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f9e2f57f-8a42-4732-ae4a-d3e8c6d1d10f tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1671 microversion: 2.1 time: 0.154820 Jun 08 13:53:07.183233 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 376/747] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:07 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:07.338246 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:07.338943 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:07.345832 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:07.346276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:07.347039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:07.347472 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:07.484412 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:07.493055 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:07.494585 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:07.495760 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a2e93a22-a1ea-4f0d-9a12-4c4c920ea95c tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.161852 Jun 08 13:53:07.496654 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 372/748] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:07 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:08.202829 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d4aa41d5-3946-4fee-a328-434a192c791a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:08.203589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d4aa41d5-3946-4fee-a328-434a192c791a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:08.211215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d4aa41d5-3946-4fee-a328-434a192c791a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:08.211678 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d4aa41d5-3946-4fee-a328-434a192c791a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:08.212621 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d4aa41d5-3946-4fee-a328-434a192c791a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:08.213339 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d4aa41d5-3946-4fee-a328-434a192c791a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:08.359072 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d4aa41d5-3946-4fee-a328-434a192c791a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:08.366747 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d4aa41d5-3946-4fee-a328-434a192c791a tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1671 microversion: 2.1 time: 0.169700 Jun 08 13:53:08.367320 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 377/749] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:08 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:08.515484 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:08.516167 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:08.522712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:08.523157 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:08.523916 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:08.524380 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:08.658781 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:08.667254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:08.669378 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:08.670986 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-77d18f3e-0e21-4271-9306-25d0ab4d3e97 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.159978 Jun 08 13:53:08.671796 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 373/750] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:08 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:09.384095 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4195d144-bc86-46a9-a799-e254624eb4cd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:09.384839 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4195d144-bc86-46a9-a799-e254624eb4cd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:09.391333 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4195d144-bc86-46a9-a799-e254624eb4cd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:09.391800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4195d144-bc86-46a9-a799-e254624eb4cd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:09.392596 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4195d144-bc86-46a9-a799-e254624eb4cd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:09.393042 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4195d144-bc86-46a9-a799-e254624eb4cd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:09.459025 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4195d144-bc86-46a9-a799-e254624eb4cd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:09.467154 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4195d144-bc86-46a9-a799-e254624eb4cd tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1604 microversion: 2.1 time: 0.086968 Jun 08 13:53:09.467734 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 378/751] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:09 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1604 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:09.567427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-a6c7c6de-6234-43bc-aa0e-d5fc231f6192 req-5ca5a1f7-19fc-4647-8917-c70fdc24ab9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff8382d-1fa6-4dbf-8c24-24e8d31e9323", "name": "network-vif-deleted", "tag": "bae22dd8-6da6-4295-940a-640e10580990"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:53:09.581365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-a6c7c6de-6234-43bc-aa0e-d5fc231f6192 req-5ca5a1f7-19fc-4647-8917-c70fdc24ab9e service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:09.581365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-a6c7c6de-6234-43bc-aa0e-d5fc231f6192 req-5ca5a1f7-19fc-4647-8917-c70fdc24ab9e service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:09.589011 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-a6c7c6de-6234-43bc-aa0e-d5fc231f6192 req-5ca5a1f7-19fc-4647-8917-c70fdc24ab9e service nova] Creating event network-vif-deleted:bae22dd8-6da6-4295-940a-640e10580990 for instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 on hv-cinder-81914 Jun 08 13:53:09.594970 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-a6c7c6de-6234-43bc-aa0e-d5fc231f6192 req-5ca5a1f7-19fc-4647-8917-c70fdc24ab9e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031756 Jun 08 13:53:09.595843 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 374/752] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:53:09.689915 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:09.690597 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:09.697224 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:09.697736 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:09.698513 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:09.698959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:09.838538 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:09.847343 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:09.848873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:09.850021 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-df42806c-24b8-42f0-a072-03f6f721c90a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.164632 Jun 08 13:53:09.850576 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 379/753] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:09 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:53:10.485484 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d077f2f3-7816-4acd-b502-208d60c1aa84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:10.486288 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d077f2f3-7816-4acd-b502-208d60c1aa84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:10.492610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d077f2f3-7816-4acd-b502-208d60c1aa84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:10.493067 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d077f2f3-7816-4acd-b502-208d60c1aa84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:10.493842 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d077f2f3-7816-4acd-b502-208d60c1aa84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:10.494286 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d077f2f3-7816-4acd-b502-208d60c1aa84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:10.557346 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d077f2f3-7816-4acd-b502-208d60c1aa84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:10.565948 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d077f2f3-7816-4acd-b502-208d60c1aa84 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1604 microversion: 2.1 time: 0.085171 Jun 08 13:53:10.566740 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 375/754] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:10 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1604 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:10.868882 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:10.869495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:10.875648 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:10.876131 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:10.876930 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:10.877376 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:11.166401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:11.174289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:11.175815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:11.177014 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ec40db2c-3f90-445b-82b1-f51552922d9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.312090 Jun 08 13:53:11.177584 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 380/755] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:10 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:11.583034 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ef715979-fa0f-41c2-88ec-648f4e6aaf37 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:11.583646 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ef715979-fa0f-41c2-88ec-648f4e6aaf37 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:11.590553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ef715979-fa0f-41c2-88ec-648f4e6aaf37 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:11.591012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ef715979-fa0f-41c2-88ec-648f4e6aaf37 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:11.591791 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ef715979-fa0f-41c2-88ec-648f4e6aaf37 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:11.592270 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ef715979-fa0f-41c2-88ec-648f4e6aaf37 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:11.655700 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ef715979-fa0f-41c2-88ec-648f4e6aaf37 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc438414709747599fba278ea9b6fecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c115dc845a497292c12e2980e9f77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:11.663139 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ef715979-fa0f-41c2-88ec-648f4e6aaf37 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 200 len: 1604 microversion: 2.1 time: 0.084011 Jun 08 13:53:11.663700 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 376/756] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:11 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 1604 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:12.194792 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:12.195382 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:12.201985 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:12.202439 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:12.203204 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:12.203644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:12.340208 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:12.348459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:12.349956 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:12.351109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1b8e1d94-f110-4ed2-bef5-660b7bc02e69 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.160314 Jun 08 13:53:12.351657 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 381/757] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:12 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:12.680720 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:12.681252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:12.688632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:12.689092 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:12.689872 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:12.690316 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:12.704800 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] HTTP exception thrown: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Request method failure captured: Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 HTTP/1.1 Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKhHqjft3HBeUZKCWjBMOPkII-exZlh-hWeMREZnVp8E_OUiCUwRUzOwYKz1P3SfkoXKMEtdptMv-cMyAKZzKE69pLnR2WUHgcSjBprJKrPYhWIDAOKxLF0RdX6UZYMJFdc1GEb9qWLGQHr9jUBHt3Na-kqPeRlKeXzO2iwUo85WYFU Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:53:12.706492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_87c115dc845a497292c12e2980e9f77b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}] Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: cc438414709747599fba278ea9b6fecf Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:12.709867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'fff8382d-1fa6-4dbf-8c24-24e8d31e9323'} Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:12.710823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:12.712450 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:12.713786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Returning 404 to user: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:12.713786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1b957f0d-b104-4b39-b46d-3136c2669ca9 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 404 len: 111 microversion: 2.1 time: 0.031310 Jun 08 13:53:12.713786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 377/758] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:12 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:53:12.717033 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-699b9a8c-a827-42dd-a7e0-094f0dd84804 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '.version_select at 0x7fe2896993a0>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:12.840553 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-699b9a8c-a827-42dd-a7e0-094f0dd84804 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-297616838" status: 202 len: 0 microversion: 2.1 time: 0.127250 Jun 08 13:53:12.846232 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 382/759] 10.222.0.55 () {58 vars in 1217 bytes} [Wed Jun 8 13:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-297616838 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:53:13.369915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:13.370687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:13.377704 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:13.378156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:13.378928 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:13.379366 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:13.522822 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:13.531512 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:13.532992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:13.534233 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-47a9ed26-2250-4b95-95ae-ca6dcde02d19 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.168318 Jun 08 13:53:13.538534 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 378/760] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:13 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:13.996822 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-8b147382-48fd-4c5c-b27c-6a9b8fe55de1 req-87e4a2f9-3b21-4686-aade-9ca5e0e791e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab28955-49eb-4750-839f-b9f2b14cb299", "name": "network-vif-plugged", "status": "completed", "tag": "3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:53:14.006074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-8b147382-48fd-4c5c-b27c-6a9b8fe55de1 req-87e4a2f9-3b21-4686-aade-9ca5e0e791e2 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:14.006438 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-8b147382-48fd-4c5c-b27c-6a9b8fe55de1 req-87e4a2f9-3b21-4686-aade-9ca5e0e791e2 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:14.016517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-8b147382-48fd-4c5c-b27c-6a9b8fe55de1 req-87e4a2f9-3b21-4686-aade-9ca5e0e791e2 service nova] Creating event network-vif-plugged:3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4 for instance dab28955-49eb-4750-839f-b9f2b14cb299 on hv-cinder-81914 Jun 08 13:53:14.021485 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-8b147382-48fd-4c5c-b27c-6a9b8fe55de1 req-87e4a2f9-3b21-4686-aade-9ca5e0e791e2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028564 Jun 08 13:53:14.022052 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 383/761] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:53:14.553633 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:14.554250 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:14.561547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:14.562006 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:14.562834 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:14.563283 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:14.693713 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:14.702412 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:14.703994 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:14.705188 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bfe02370-5897-47f0-b65c-6ad089d763fd tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.155663 Jun 08 13:53:14.705794 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 379/762] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:14 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:15.723956 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:15.724689 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:15.731604 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:15.732074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:15.738797 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:15.738797 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:15.872157 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:15.880251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:15.881802 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:15.882996 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-452bc4bf-27ed-4f81-a703-59dd967ebc7a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.164043 Jun 08 13:53:15.883583 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 384/763] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:15 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:16.247470 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:16.248992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:16.254495 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:16.254951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:16.255711 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:16.256184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:16.270262 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] HTTP exception thrown: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Request method failure captured: Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: DELETE /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 HTTP/1.1 Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKhHqjft3HBeUZKCWjBMOPkII-exZlh-hWeMREZnVp8E_OUiCUwRUzOwYKz1P3SfkoXKMEtdptMv-cMyAKZzKE69pLnR2WUHgcSjBprJKrPYhWIDAOKxLF0RdX6UZYMJFdc1GEb9qWLGQHr9jUBHt3Na-kqPeRlKeXzO2iwUo85WYFU Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:53:16.271968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_87c115dc845a497292c12e2980e9f77b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}] Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: cc438414709747599fba278ea9b6fecf Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.279158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'fff8382d-1fa6-4dbf-8c24-24e8d31e9323'} Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:16.279887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.281141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.282378 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Returning 404 to user: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:16.282378 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fd1310ca-2d28-46f7-bcbb-d7d218e8f0d4 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 404 len: 111 microversion: 2.1 time: 0.030380 Jun 08 13:53:16.282378 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 380/764] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:53:16 2022] DELETE /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:53:16.282577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:16.282577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: fff8382d-1fa6-4dbf-8c24-24e8d31e9323] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:16.288329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:16.288781 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:16.289567 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:16.290174 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:16.304370 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] HTTP exception thrown: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Request method failure captured: Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 HTTP/1.1 Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKhHqjft3HBeUZKCWjBMOPkII-exZlh-hWeMREZnVp8E_OUiCUwRUzOwYKz1P3SfkoXKMEtdptMv-cMyAKZzKE69pLnR2WUHgcSjBprJKrPYhWIDAOKxLF0RdX6UZYMJFdc1GEb9qWLGQHr9jUBHt3Na-kqPeRlKeXzO2iwUo85WYFU Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:53:16.305472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_87c115dc845a497292c12e2980e9f77b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}] Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: cc438414709747599fba278ea9b6fecf Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.307097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'fff8382d-1fa6-4dbf-8c24-24e8d31e9323'} Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:16.307892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. Jun 08 13:53:16.310149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:16.311462 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Returning 404 to user: Instance fff8382d-1fa6-4dbf-8c24-24e8d31e9323 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:16.311462 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-72432f8d-4156-4ed2-8003-77515960d940 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323" status: 404 len: 111 microversion: 2.1 time: 0.028862 Jun 08 13:53:16.311462 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 385/765] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:16 2022] GET /compute/v2.1/servers/fff8382d-1fa6-4dbf-8c24-24e8d31e9323 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:53:16.900998 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:16.901722 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:16.904547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:16.909542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:16.909991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:16.910815 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:16.911251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:17.045548 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:17.053740 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:17.055314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:17.056521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8b3bad77-bb33-4e59-9951-3d37d69b0966 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1728 microversion: 2.20 time: 0.159626 Jun 08 13:53:17.057076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 381/766] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:16 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:17.566833 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:17.567338 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:17.569793 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:17.575251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:17.575710 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:17.576507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:17.576995 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:17.590874 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] HTTP exception thrown: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Request method failure captured: Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: DELETE /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 HTTP/1.1 Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKhHqjft3HBeUZKCWjBMOPkII-exZlh-hWeMREZnVp8E_OUiCUwRUzOwYKz1P3SfkoXKMEtdptMv-cMyAKZzKE69pLnR2WUHgcSjBprJKrPYhWIDAOKxLF0RdX6UZYMJFdc1GEb9qWLGQHr9jUBHt3Na-kqPeRlKeXzO2iwUo85WYFU Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:53:17.592459 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_87c115dc845a497292c12e2980e9f77b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}] Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: cc438414709747599fba278ea9b6fecf Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.593994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '1db0ac6d-b933-4abd-96b8-c1af36e06791'} Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:17.594898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.596609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.598041 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Returning 404 to user: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:17.598041 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-cfb7a75a-e8e3-4c5b-8d09-6f3042aa8321 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "DELETE /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 404 len: 111 microversion: 2.1 time: 0.030968 Jun 08 13:53:17.598041 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 386/767] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:53:17 2022] DELETE /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:53:17.602755 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:17.603374 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] [instance: 1db0ac6d-b933-4abd-96b8-c1af36e06791] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:17.610350 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:17.610802 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:17.611572 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:17.612012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:17.625251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] HTTP exception thrown: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Request method failure captured: Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 HTTP/1.1 Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKhHqjft3HBeUZKCWjBMOPkII-exZlh-hWeMREZnVp8E_OUiCUwRUzOwYKz1P3SfkoXKMEtdptMv-cMyAKZzKE69pLnR2WUHgcSjBprJKrPYhWIDAOKxLF0RdX6UZYMJFdc1GEb9qWLGQHr9jUBHt3Na-kqPeRlKeXzO2iwUo85WYFU Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:53:17.626779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_87c115dc845a497292c12e2980e9f77b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/87c115dc845a497292c12e2980e9f77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/87c115dc845a497292c12e2980e9f77b"}]}] Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 87c115dc845a497292c12e2980e9f77b Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-451720990 Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: cc438414709747599fba278ea9b6fecf Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeTestJSON-451720990-project Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.628376 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '1db0ac6d-b933-4abd-96b8-c1af36e06791'} Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:17.629276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. Jun 08 13:53:17.630731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:17.632081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] Returning 404 to user: Instance 1db0ac6d-b933-4abd-96b8-c1af36e06791 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:17.632081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e81a0ad0-9b04-4f01-b2df-10a378ab1c93 tempest-AttachVolumeTestJSON-451720990 tempest-AttachVolumeTestJSON-451720990-project] 10.222.0.55 "GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791" status: 404 len: 111 microversion: 2.1 time: 0.029324 Jun 08 13:53:17.632081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 382/768] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:17 2022] GET /compute/v2.1/servers/1db0ac6d-b933-4abd-96b8-c1af36e06791 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 13:53:18.076568 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:18.077336 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:18.084354 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:18.085374 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:18.086171 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:18.086609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:18.328703 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:18.337013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:18.338564 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:18.344295 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-336b4a2f-f967-44c8-8fb2-1b68ee5cd5b2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1715 microversion: 2.20 time: 0.268963 Jun 08 13:53:18.356078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 387/769] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:18 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1715 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 08 13:53:28.965310 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:28.966515 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:29.083917 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2ab02245-4ff0-482b-8128-444f5055e920 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: .version_select at 0x7fe28951e790>, body: {"keypair": {"name": "tempest-keypair-1332402640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtytM0s0tVAgOEC2FuKCxs+RxMYpV9TCghyk3a5nQDP3SprcQqZFvDfFZxH9C3mgao65t3O1SYq2DNSGt8EHjaI+p4vttRHO6rZOyC78OQOHjEt0nv7q9D+yel1thHPFw=="}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:53:29.101632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-2ab02245-4ff0-482b-8128-444f5055e920 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:53:29.106839 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-2ab02245-4ff0-482b-8128-444f5055e920 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for user e50a12d7facd4e4184d79bbac03bfa74 and project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:53:29.237275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2ab02245-4ff0-482b-8128-444f5055e920 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.277215 Jun 08 13:53:29.237898 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 383/770] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 13:53:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:53:31.602682 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-420346808", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8461b72-4585-42eb-adf7-269bbd08f24f"}], "security_groups": [{"name": "tempest-securitygroup--1696258506"}], "key_name": "tempest-keypair-1332402640", "user_data": "}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:53:31.610103 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:31.610762 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=55 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:31.711716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] validate_networks() for [('e8461b72-4585-42eb-adf7-269bbd08f24f', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:53:32.273884 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:53:32.274523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:53:32.275012 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:53:32.275429 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:53:32.275845 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:53:32.286697 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:32.287140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:32.287949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:32.288464 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:32.310389 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:53:32.314758 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for user e50a12d7facd4e4184d79bbac03bfa74 and project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:53:32.328430 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:53:32.330738 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:53:32.476820 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ce7d7797-f962-41d2-8cd1-f2f22385ffe3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.878577 Jun 08 13:53:32.477568 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 388/771] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:53:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:53:32.488666 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-13213d73-c8f2-4135-a003-73362a5911c8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:32.489438 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-13213d73-c8f2-4135-a003-73362a5911c8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:32.782855 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-13213d73-c8f2-4135-a003-73362a5911c8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:32.790791 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-13213d73-c8f2-4135-a003-73362a5911c8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1241 microversion: 2.1 time: 0.306371 Jun 08 13:53:32.791284 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 384/772] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:32 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1241 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:33.809859 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-26212aec-5636-4543-a6dc-088c5991447e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:33.810478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-26212aec-5636-4543-a6dc-088c5991447e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:33.817145 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-26212aec-5636-4543-a6dc-088c5991447e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:33.817598 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-26212aec-5636-4543-a6dc-088c5991447e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:33.818374 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-26212aec-5636-4543-a6dc-088c5991447e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:33.818811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-26212aec-5636-4543-a6dc-088c5991447e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:33.893181 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-26212aec-5636-4543-a6dc-088c5991447e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:33.900275 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-26212aec-5636-4543-a6dc-088c5991447e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1237 microversion: 2.1 time: 0.095819 Jun 08 13:53:33.901280 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 389/773] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:33 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:34.918277 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2731c597-12a4-4967-a742-555f9daa8574 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:34.919964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2731c597-12a4-4967-a742-555f9daa8574 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:34.927170 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2731c597-12a4-4967-a742-555f9daa8574 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:34.927530 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2731c597-12a4-4967-a742-555f9daa8574 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:34.928329 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2731c597-12a4-4967-a742-555f9daa8574 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:34.928768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2731c597-12a4-4967-a742-555f9daa8574 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:34.997083 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2731c597-12a4-4967-a742-555f9daa8574 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:35.004754 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2731c597-12a4-4967-a742-555f9daa8574 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1299 microversion: 2.1 time: 0.090365 Jun 08 13:53:35.005315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 385/774] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:34 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:36.022728 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1070291f-a05b-4ec8-8c76-81162576ddce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:36.023421 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1070291f-a05b-4ec8-8c76-81162576ddce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:36.030676 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1070291f-a05b-4ec8-8c76-81162576ddce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:36.031064 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1070291f-a05b-4ec8-8c76-81162576ddce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:36.031819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1070291f-a05b-4ec8-8c76-81162576ddce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:36.032281 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1070291f-a05b-4ec8-8c76-81162576ddce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:36.168309 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1070291f-a05b-4ec8-8c76-81162576ddce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:36.172686 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1070291f-a05b-4ec8-8c76-81162576ddce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1367 microversion: 2.1 time: 0.153826 Jun 08 13:53:36.173251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 390/775] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:36 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:36.558640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-54238be3-ef73-437a-87f5-ac85311b1c00 req-70812c96-421f-405b-8903-b9f6b6bb1b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec5f074e-36e2-487e-9c9f-b613edaa6bf0", "tag": "74879222-2c74-48ad-9499-8d5ec0700aa7"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:53:36.569133 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-54238be3-ef73-437a-87f5-ac85311b1c00 req-70812c96-421f-405b-8903-b9f6b6bb1b84 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:36.572271 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-54238be3-ef73-437a-87f5-ac85311b1c00 req-70812c96-421f-405b-8903-b9f6b6bb1b84 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:36.587584 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-54238be3-ef73-437a-87f5-ac85311b1c00 req-70812c96-421f-405b-8903-b9f6b6bb1b84 service nova] Creating event network-changed:74879222-2c74-48ad-9499-8d5ec0700aa7 for instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 on hv-cinder-81914 Jun 08 13:53:36.594731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-54238be3-ef73-437a-87f5-ac85311b1c00 req-70812c96-421f-405b-8903-b9f6b6bb1b84 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039688 Jun 08 13:53:36.599484 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 386/776] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:53:37.189302 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5a3dac0d-79f0-48fd-8bb8-5b732b393a9c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:37.189931 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5a3dac0d-79f0-48fd-8bb8-5b732b393a9c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:37.196503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a3dac0d-79f0-48fd-8bb8-5b732b393a9c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:37.196959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a3dac0d-79f0-48fd-8bb8-5b732b393a9c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:37.198393 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a3dac0d-79f0-48fd-8bb8-5b732b393a9c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:37.198837 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5a3dac0d-79f0-48fd-8bb8-5b732b393a9c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:37.329329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5a3dac0d-79f0-48fd-8bb8-5b732b393a9c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:37.336702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5a3dac0d-79f0-48fd-8bb8-5b732b393a9c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1367 microversion: 2.1 time: 0.151258 Jun 08 13:53:37.337267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 391/777] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:37 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:38.356909 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d88a76af-2fb0-43d0-8870-3fe23b6a1d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:38.357659 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d88a76af-2fb0-43d0-8870-3fe23b6a1d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:38.364196 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d88a76af-2fb0-43d0-8870-3fe23b6a1d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:38.364652 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d88a76af-2fb0-43d0-8870-3fe23b6a1d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:38.365422 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d88a76af-2fb0-43d0-8870-3fe23b6a1d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:38.365868 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d88a76af-2fb0-43d0-8870-3fe23b6a1d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:38.498714 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d88a76af-2fb0-43d0-8870-3fe23b6a1d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:38.506086 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d88a76af-2fb0-43d0-8870-3fe23b6a1d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1367 microversion: 2.1 time: 0.155116 Jun 08 13:53:38.506737 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 387/778] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:38 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:39.522639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-58b49794-78fb-46a3-b9f7-351bab687de6 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:39.523282 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-58b49794-78fb-46a3-b9f7-351bab687de6 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:39.530269 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-58b49794-78fb-46a3-b9f7-351bab687de6 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:39.530723 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-58b49794-78fb-46a3-b9f7-351bab687de6 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:39.531504 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-58b49794-78fb-46a3-b9f7-351bab687de6 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:39.531947 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-58b49794-78fb-46a3-b9f7-351bab687de6 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:39.659189 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-58b49794-78fb-46a3-b9f7-351bab687de6 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:39.666655 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-58b49794-78fb-46a3-b9f7-351bab687de6 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1367 microversion: 2.1 time: 0.147877 Jun 08 13:53:39.667420 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 392/779] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:39 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:40.683824 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-80e76dea-a6c7-4228-8b8c-10e9d9bddd4c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:40.684488 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-80e76dea-a6c7-4228-8b8c-10e9d9bddd4c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:40.691043 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-80e76dea-a6c7-4228-8b8c-10e9d9bddd4c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:40.691495 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-80e76dea-a6c7-4228-8b8c-10e9d9bddd4c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:40.692297 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-80e76dea-a6c7-4228-8b8c-10e9d9bddd4c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:40.692739 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-80e76dea-a6c7-4228-8b8c-10e9d9bddd4c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:40.819955 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-80e76dea-a6c7-4228-8b8c-10e9d9bddd4c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:40.827872 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-80e76dea-a6c7-4228-8b8c-10e9d9bddd4c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1367 microversion: 2.1 time: 0.148267 Jun 08 13:53:40.828476 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 388/780] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:40 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:41.845090 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ac03f437-ff39-49cd-8bf1-c3ed912f19cd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:41.845892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ac03f437-ff39-49cd-8bf1-c3ed912f19cd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:41.852415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac03f437-ff39-49cd-8bf1-c3ed912f19cd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:41.852874 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac03f437-ff39-49cd-8bf1-c3ed912f19cd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:41.853646 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac03f437-ff39-49cd-8bf1-c3ed912f19cd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:41.854102 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac03f437-ff39-49cd-8bf1-c3ed912f19cd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:41.984902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ac03f437-ff39-49cd-8bf1-c3ed912f19cd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:41.992440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ac03f437-ff39-49cd-8bf1-c3ed912f19cd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1367 microversion: 2.1 time: 0.151339 Jun 08 13:53:41.993008 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 393/781] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:41 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:42.232967 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-be5a6801-ed48-4929-addb-23b26cfd580b req-3f51aae4-503a-46ae-81f0-690ad7f3deec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec5f074e-36e2-487e-9c9f-b613edaa6bf0", "name": "network-vif-plugged", "status": "completed", "tag": "74879222-2c74-48ad-9499-8d5ec0700aa7"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:53:42.242611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-be5a6801-ed48-4929-addb-23b26cfd580b req-3f51aae4-503a-46ae-81f0-690ad7f3deec service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:42.243064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-be5a6801-ed48-4929-addb-23b26cfd580b req-3f51aae4-503a-46ae-81f0-690ad7f3deec service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:42.259026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-be5a6801-ed48-4929-addb-23b26cfd580b req-3f51aae4-503a-46ae-81f0-690ad7f3deec service nova] Creating event network-vif-plugged:74879222-2c74-48ad-9499-8d5ec0700aa7 for instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 on hv-cinder-81914 Jun 08 13:53:42.265838 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-be5a6801-ed48-4929-addb-23b26cfd580b req-3f51aae4-503a-46ae-81f0-690ad7f3deec service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036666 Jun 08 13:53:42.266658 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 389/782] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:53:43.009311 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2048547a-06ed-40fb-95c7-c0842e50e756 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:43.010432 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2048547a-06ed-40fb-95c7-c0842e50e756 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:43.012316 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:43.013004 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=6 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:43.018335 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2048547a-06ed-40fb-95c7-c0842e50e756 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:43.018760 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2048547a-06ed-40fb-95c7-c0842e50e756 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:43.019575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2048547a-06ed-40fb-95c7-c0842e50e756 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:43.020017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2048547a-06ed-40fb-95c7-c0842e50e756 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:43.150235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2048547a-06ed-40fb-95c7-c0842e50e756 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:43.158272 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2048547a-06ed-40fb-95c7-c0842e50e756 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1367 microversion: 2.1 time: 0.152946 Jun 08 13:53:43.158841 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 394/783] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:43 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:44.175238 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-318b83e0-3b7c-40cf-afda-d78ecc26c4ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:44.175936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-318b83e0-3b7c-40cf-afda-d78ecc26c4ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:44.177938 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=6 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:53:44.184498 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-318b83e0-3b7c-40cf-afda-d78ecc26c4ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:44.185884 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-318b83e0-3b7c-40cf-afda-d78ecc26c4ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:44.185884 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-318b83e0-3b7c-40cf-afda-d78ecc26c4ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:44.186717 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-318b83e0-3b7c-40cf-afda-d78ecc26c4ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:44.322153 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-318b83e0-3b7c-40cf-afda-d78ecc26c4ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:44.331248 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-318b83e0-3b7c-40cf-afda-d78ecc26c4ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1556 microversion: 2.1 time: 0.160247 Jun 08 13:53:44.331824 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 390/784] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:53:44 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:44.349239 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-943e38d6-da8f-4147-9fe2-14155c1460cc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:44.349742 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-943e38d6-da8f-4147-9fe2-14155c1460cc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:44.356516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-943e38d6-da8f-4147-9fe2-14155c1460cc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:44.356960 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-943e38d6-da8f-4147-9fe2-14155c1460cc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:44.357762 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-943e38d6-da8f-4147-9fe2-14155c1460cc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:44.358155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-943e38d6-da8f-4147-9fe2-14155c1460cc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:44.433594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-943e38d6-da8f-4147-9fe2-14155c1460cc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088451 Jun 08 13:53:44.434413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 395/785] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 8 13:53:44 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:53:45.403951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-a0dd45cc-f9ea-4f8f-a61b-85294869f9e5 req-eff7f30b-dd6b-4560-8100-62a18c70b352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec5f074e-36e2-487e-9c9f-b613edaa6bf0", "tag": "74879222-2c74-48ad-9499-8d5ec0700aa7"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:53:45.412477 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-a0dd45cc-f9ea-4f8f-a61b-85294869f9e5 req-eff7f30b-dd6b-4560-8100-62a18c70b352 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:45.412933 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-a0dd45cc-f9ea-4f8f-a61b-85294869f9e5 req-eff7f30b-dd6b-4560-8100-62a18c70b352 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:45.425164 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-a0dd45cc-f9ea-4f8f-a61b-85294869f9e5 req-eff7f30b-dd6b-4560-8100-62a18c70b352 service nova] Creating event network-changed:74879222-2c74-48ad-9499-8d5ec0700aa7 for instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 on hv-cinder-81914 Jun 08 13:53:45.430075 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-a0dd45cc-f9ea-4f8f-a61b-85294869f9e5 req-eff7f30b-dd6b-4560-8100-62a18c70b352 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031157 Jun 08 13:53:45.431062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 391/786] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:53:49.444737 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2ca4115c-22f3-4e21-8eb7-6ab578391490 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:49.445757 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2ca4115c-22f3-4e21-8eb7-6ab578391490 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:49.451713 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2ca4115c-22f3-4e21-8eb7-6ab578391490 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:49.452212 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2ca4115c-22f3-4e21-8eb7-6ab578391490 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:49.452975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2ca4115c-22f3-4e21-8eb7-6ab578391490 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:49.453415 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2ca4115c-22f3-4e21-8eb7-6ab578391490 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:49.484821 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2ca4115c-22f3-4e21-8eb7-6ab578391490 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044748 Jun 08 13:53:49.485375 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 396/787] 10.222.0.55 () {60 vars in 1342 bytes} [Wed Jun 8 13:53:49 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:53:49.543035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-41b4458d-5c92-4a8e-afa2-7d221843fd9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:49.543756 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-41b4458d-5c92-4a8e-afa2-7d221843fd9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:49.550267 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-41b4458d-5c92-4a8e-afa2-7d221843fd9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:49.551098 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-41b4458d-5c92-4a8e-afa2-7d221843fd9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:49.551466 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-41b4458d-5c92-4a8e-afa2-7d221843fd9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:49.551933 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-41b4458d-5c92-4a8e-afa2-7d221843fd9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:49.576715 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-41b4458d-5c92-4a8e-afa2-7d221843fd9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:53:50.049231 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-41b4458d-5c92-4a8e-afa2-7d221843fd9b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "DELETE /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 204 len: 0 microversion: 2.20 time: 0.510551 Jun 08 13:53:50.049756 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 392/788] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 8 13:53:49 2022] DELETE /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 08 13:53:50.058516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:50.059131 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:50.065423 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:50.065918 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:50.066698 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:50.067173 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:50.199428 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:50.207374 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:50.208914 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:50.210082 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6c0bcb85-7cd4-48b2-8721-63d746aa12d8 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.156034 Jun 08 13:53:50.210640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 397/789] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:50 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:51.229891 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:51.230593 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:51.237193 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:51.237649 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:51.238417 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:51.238906 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:51.370751 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:51.378631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:51.380149 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:51.381308 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-42c7ee50-f334-49b0-a35f-ad37da219c2e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1721 microversion: 2.20 time: 0.156405 Jun 08 13:53:51.381861 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 393/790] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:51 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:52.348197 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-5ed28c06-9cac-4d59-a1d3-47321bb9d865 req-c8e14d90-b860-4412-81b5-cda12c0e1535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab28955-49eb-4750-839f-b9f2b14cb299", "name": "network-vif-deleted", "tag": "3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:53:52.357237 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-5ed28c06-9cac-4d59-a1d3-47321bb9d865 req-c8e14d90-b860-4412-81b5-cda12c0e1535 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:52.358516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-5ed28c06-9cac-4d59-a1d3-47321bb9d865 req-c8e14d90-b860-4412-81b5-cda12c0e1535 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:52.370211 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-5ed28c06-9cac-4d59-a1d3-47321bb9d865 req-c8e14d90-b860-4412-81b5-cda12c0e1535 service nova] Creating event network-vif-deleted:3fbb104b-633a-4cc4-9b4f-4b9bf79cbab4 for instance dab28955-49eb-4750-839f-b9f2b14cb299 on hv-cinder-81914 Jun 08 13:53:52.375330 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-5ed28c06-9cac-4d59-a1d3-47321bb9d865 req-c8e14d90-b860-4412-81b5-cda12c0e1535 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 Jun 08 13:53:52.375907 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 398/791] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:53:52.399490 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:52.400225 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:52.406830 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:52.407353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:52.408257 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:52.408754 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:52.487192 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:52.499944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:52.501524 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b970b89c20645d98da510e03a915fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc65fa99694daa81878db0200bdb4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:53:52.502751 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-711d5ce8-7ff7-4c0e-8891-3f6fbffaac27 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 200 len: 1653 microversion: 2.20 time: 0.107288 Jun 08 13:53:52.503358 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 394/792] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:52 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 1653 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 08 13:53:53.525485 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:53.526274 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:53.532612 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:53.533070 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:53.533838 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:53.534276 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:53.547885 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] HTTP exception thrown: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Request method failure captured: Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 HTTP/1.1 Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKhOMg0sQ6j2KBIutHS3ZyoENBz50XCeNH8japzptI5VAh0odtZjvahg0bHSv5T7jRtkm5Oy4CWbLLc4prA7Lb5NH3f98jSFB6yarXxcLtxrUgGG_CGlvJqnXMQHW1reC2vJt5-wDjmqPCwsjuI0-VNfiwHAaQFBgnSjm0qfNdtOFHI Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:53:53.549570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0cc65fa99694daa81878db0200bdb4b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}] Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 1b970b89c20645d98da510e03a915fd5 Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:53.551267 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'dab28955-49eb-4750-839f-b9f2b14cb299'} Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:53.552093 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:53.553587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:53.555209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Returning 404 to user: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:53.555209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a384ae38-a421-43cd-b2cb-2e1623a903e2 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 404 len: 111 microversion: 2.20 time: 0.031110 Jun 08 13:53:53.555209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 399/793] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:53 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:53:53.560392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8f498199-3ab1-49f8-b5fa-4066c0b60c35 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '.version_select at 0x7fe2897891f0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:53.655276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8f498199-3ab1-49f8-b5fa-4066c0b60c35 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325981222" status: 204 len: 0 microversion: 2.20 time: 0.099171 Jun 08 13:53:53.655892 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 395/794] 10.222.0.55 () {60 vars in 1261 bytes} [Wed Jun 8 13:53:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325981222 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 08 13:53:55.731342 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:55.735891 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:55.738538 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:55.738982 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:55.739743 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:55.740224 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:55.753555 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] HTTP exception thrown: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Request method failure captured: Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: DELETE /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 HTTP/1.1 Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKhOMg0sQ6j2KBIutHS3ZyoENBz50XCeNH8japzptI5VAh0odtZjvahg0bHSv5T7jRtkm5Oy4CWbLLc4prA7Lb5NH3f98jSFB6yarXxcLtxrUgGG_CGlvJqnXMQHW1reC2vJt5-wDjmqPCwsjuI0-VNfiwHAaQFBgnSjm0qfNdtOFHI Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:53:55.755132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0cc65fa99694daa81878db0200bdb4b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}] Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 1b970b89c20645d98da510e03a915fd5 Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.756815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'dab28955-49eb-4750-839f-b9f2b14cb299'} Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:55.757688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.759693 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.761541 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Returning 404 to user: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:55.761541 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2a673f87-8dd7-41d8-b509-70efff2c557e tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "DELETE /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 404 len: 111 microversion: 2.20 time: 0.029831 Jun 08 13:53:55.761541 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 400/795] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 8 13:53:55 2022] DELETE /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:53:55.765772 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:55.766391 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: dab28955-49eb-4750-839f-b9f2b14cb299] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:55.773866 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:55.774314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:55.775992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:55.776469 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:55.789499 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] HTTP exception thrown: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Request method failure captured: Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 HTTP/1.1 Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKhOMg0sQ6j2KBIutHS3ZyoENBz50XCeNH8japzptI5VAh0odtZjvahg0bHSv5T7jRtkm5Oy4CWbLLc4prA7Lb5NH3f98jSFB6yarXxcLtxrUgGG_CGlvJqnXMQHW1reC2vJt5-wDjmqPCwsjuI0-VNfiwHAaQFBgnSjm0qfNdtOFHI Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:53:55.791420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0cc65fa99694daa81878db0200bdb4b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}] Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 1b970b89c20645d98da510e03a915fd5 Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.793059 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'dab28955-49eb-4750-839f-b9f2b14cb299'} Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:55.795026 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. Jun 08 13:53:55.796230 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:55.797334 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Returning 404 to user: Instance dab28955-49eb-4750-839f-b9f2b14cb299 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:55.797334 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-423af9f3-fe46-4abf-a52a-f2df1ddf742a tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299" status: 404 len: 111 microversion: 2.20 time: 0.031115 Jun 08 13:53:55.797334 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 396/796] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:55 2022] GET /compute/v2.1/servers/dab28955-49eb-4750-839f-b9f2b14cb299 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:53:57.072810 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:57.073306 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:57.079628 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:57.080107 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:57.080869 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:57.081303 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:57.095329 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] HTTP exception thrown: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Request method failure captured: Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: DELETE /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b HTTP/1.1 Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKhOMg0sQ6j2KBIutHS3ZyoENBz50XCeNH8japzptI5VAh0odtZjvahg0bHSv5T7jRtkm5Oy4CWbLLc4prA7Lb5NH3f98jSFB6yarXxcLtxrUgGG_CGlvJqnXMQHW1reC2vJt5-wDjmqPCwsjuI0-VNfiwHAaQFBgnSjm0qfNdtOFHI Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:53:57.096991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0cc65fa99694daa81878db0200bdb4b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}] Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 1b970b89c20645d98da510e03a915fd5 Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.098658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'ac779098-8aa5-40b8-ae7d-dc4e463f015b'} Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:57.102401 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.104383 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.105594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Returning 404 to user: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:57.105594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-046e5464-9e07-41b6-9d46-46c801e4e842 tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 404 len: 111 microversion: 2.20 time: 0.029593 Jun 08 13:53:57.105594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 401/797] 10.222.0.55 () {60 vars in 1279 bytes} [Wed Jun 8 13:53:57 2022] DELETE /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:53:57.107770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:53:57.108535 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] [instance: ac779098-8aa5-40b8-ae7d-dc4e463f015b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:53:57.115094 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:57.115548 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:57.116357 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:53:57.116805 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:53:57.131028 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] HTTP exception thrown: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Request method failure captured: Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b HTTP/1.1 Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKhOMg0sQ6j2KBIutHS3ZyoENBz50XCeNH8japzptI5VAh0odtZjvahg0bHSv5T7jRtkm5Oy4CWbLLc4prA7Lb5NH3f98jSFB6yarXxcLtxrUgGG_CGlvJqnXMQHW1reC2vJt5-wDjmqPCwsjuI0-VNfiwHAaQFBgnSjm0qfNdtOFHI Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Openstack-Nova-Api-Version: 2.20 Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:53:57.132601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0cc65fa99694daa81878db0200bdb4b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0cc65fa99694daa81878db0200bdb4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0cc65fa99694daa81878db0200bdb4b"}]}] Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: d0cc65fa99694daa81878db0200bdb4b Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519928336 Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 1b970b89c20645d98da510e03a915fd5 Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519928336-project Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.134695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'ac779098-8aa5-40b8-ae7d-dc4e463f015b'} Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:53:57.135864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. Jun 08 13:53:57.137370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:53:57.138936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] Returning 404 to user: Instance ac779098-8aa5-40b8-ae7d-dc4e463f015b could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:53:57.138936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-64cc041b-5594-4bb7-93c0-6c953a10243b tempest-AttachVolumeShelveTestJSON-1519928336 tempest-AttachVolumeShelveTestJSON-1519928336-project] 10.222.0.55 "GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b" status: 404 len: 111 microversion: 2.20 time: 0.031023 Jun 08 13:53:57.138936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 397/798] 10.222.0.55 () {60 vars in 1276 bytes} [Wed Jun 8 13:53:57 2022] GET /compute/v2.1/servers/ac779098-8aa5-40b8-ae7d-dc4e463f015b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:54:19.842538 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-df1f2325-8dd4-4f62-9409-3dfb55c94bff tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:19.844351 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-df1f2325-8dd4-4f62-9409-3dfb55c94bff tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:19.845830 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:19.846670 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=62 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:19.851516 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df1f2325-8dd4-4f62-9409-3dfb55c94bff tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:19.851966 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df1f2325-8dd4-4f62-9409-3dfb55c94bff tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:19.852769 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df1f2325-8dd4-4f62-9409-3dfb55c94bff tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:19.853324 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-df1f2325-8dd4-4f62-9409-3dfb55c94bff tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:19.878043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-df1f2325-8dd4-4f62-9409-3dfb55c94bff tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lazy-loading 'flavor' on Instance uuid c573f844-d6af-4615-8cc2-191728d83c45 {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:54:20.132634 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-df1f2325-8dd4-4f62-9409-3dfb55c94bff tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "POST /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45/action" status: 202 len: 0 microversion: 2.1 time: 0.294954 Jun 08 13:54:20.135598 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 402/799] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:54:19 2022] POST /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:54:20.142947 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3e7ceb93-6fd4-4e94-9964-f2890e1ff53a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:20.143570 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3e7ceb93-6fd4-4e94-9964-f2890e1ff53a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:20.145965 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:20.146899 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:20.152147 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3e7ceb93-6fd4-4e94-9964-f2890e1ff53a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:20.152596 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3e7ceb93-6fd4-4e94-9964-f2890e1ff53a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:20.153367 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3e7ceb93-6fd4-4e94-9964-f2890e1ff53a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:20.153819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3e7ceb93-6fd4-4e94-9964-f2890e1ff53a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:20.286390 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3e7ceb93-6fd4-4e94-9964-f2890e1ff53a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:20.294935 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3e7ceb93-6fd4-4e94-9964-f2890e1ff53a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.155971 Jun 08 13:54:20.295496 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 398/800] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:20 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:21.242420 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-66ba3d37-8993-499b-8fc7-532ce4857b6a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:21.243007 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-66ba3d37-8993-499b-8fc7-532ce4857b6a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:21.249400 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66ba3d37-8993-499b-8fc7-532ce4857b6a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:21.249849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66ba3d37-8993-499b-8fc7-532ce4857b6a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:21.250644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66ba3d37-8993-499b-8fc7-532ce4857b6a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:21.251074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-66ba3d37-8993-499b-8fc7-532ce4857b6a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:21.275323 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-66ba3d37-8993-499b-8fc7-532ce4857b6a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/ips" status: 200 len: 149 microversion: 2.1 time: 0.037087 Jun 08 13:54:21.276091 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 403/801] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:54:21 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:54:21.313404 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e98ef1f2-74c6-4620-acd9-86afb1ed7cb2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:21.314111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e98ef1f2-74c6-4620-acd9-86afb1ed7cb2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:21.322553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e98ef1f2-74c6-4620-acd9-86afb1ed7cb2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:21.323031 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e98ef1f2-74c6-4620-acd9-86afb1ed7cb2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:21.324200 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e98ef1f2-74c6-4620-acd9-86afb1ed7cb2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:21.324800 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e98ef1f2-74c6-4620-acd9-86afb1ed7cb2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:21.464190 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e98ef1f2-74c6-4620-acd9-86afb1ed7cb2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:21.471796 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e98ef1f2-74c6-4620-acd9-86afb1ed7cb2 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.162827 Jun 08 13:54:21.473518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 399/802] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:21 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:22.489179 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-cbd07010-1c3a-488b-8aa4-8d14e389d76a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:22.489854 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-cbd07010-1c3a-488b-8aa4-8d14e389d76a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:22.496433 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cbd07010-1c3a-488b-8aa4-8d14e389d76a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:22.496887 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cbd07010-1c3a-488b-8aa4-8d14e389d76a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:22.497648 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cbd07010-1c3a-488b-8aa4-8d14e389d76a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:22.498085 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-cbd07010-1c3a-488b-8aa4-8d14e389d76a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:22.642756 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-cbd07010-1c3a-488b-8aa4-8d14e389d76a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:22.650908 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-cbd07010-1c3a-488b-8aa4-8d14e389d76a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.165556 Jun 08 13:54:22.651510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 404/803] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:22 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:23.002281 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-cc8d4544-f2e7-48b7-b3bf-0f95d7adf304 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b42cc4d-fae5-4f91-aca4-4520258cce9a"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:23.003406 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-cc8d4544-f2e7-48b7-b3bf-0f95d7adf304 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:23.011282 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cc8d4544-f2e7-48b7-b3bf-0f95d7adf304 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:23.011736 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cc8d4544-f2e7-48b7-b3bf-0f95d7adf304 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:23.012611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cc8d4544-f2e7-48b7-b3bf-0f95d7adf304 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:23.013050 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cc8d4544-f2e7-48b7-b3bf-0f95d7adf304 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:23.668990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0cb36398-0003-42be-b26e-19e6249791ab tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:23.669617 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0cb36398-0003-42be-b26e-19e6249791ab tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:23.676220 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0cb36398-0003-42be-b26e-19e6249791ab tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:23.676680 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0cb36398-0003-42be-b26e-19e6249791ab tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:23.677454 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0cb36398-0003-42be-b26e-19e6249791ab tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:23.677900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0cb36398-0003-42be-b26e-19e6249791ab tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:23.789846 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-cc8d4544-f2e7-48b7-b3bf-0f95d7adf304 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792457 Jun 08 13:54:23.791077 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 400/804] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:54:22 2022] POST /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments => generated 194 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:54:23.825528 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-0cb36398-0003-42be-b26e-19e6249791ab tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:23.834586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0cb36398-0003-42be-b26e-19e6249791ab tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.170291 Jun 08 13:54:23.835658 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 405/805] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:23 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:54:24.855163 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a53d35dd-bcad-429d-80d5-eb0de24c2bfc tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:24.857234 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a53d35dd-bcad-429d-80d5-eb0de24c2bfc tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:24.864158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a53d35dd-bcad-429d-80d5-eb0de24c2bfc tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:24.864611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a53d35dd-bcad-429d-80d5-eb0de24c2bfc tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:24.865420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a53d35dd-bcad-429d-80d5-eb0de24c2bfc tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:24.866238 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a53d35dd-bcad-429d-80d5-eb0de24c2bfc tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:25.013746 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a53d35dd-bcad-429d-80d5-eb0de24c2bfc tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:25.021291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a53d35dd-bcad-429d-80d5-eb0de24c2bfc tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.171954 Jun 08 13:54:25.021854 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 401/806] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:24 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:26.038472 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d6bf9d0c-fd3b-40ac-aaeb-44bb72ddee0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:26.039096 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d6bf9d0c-fd3b-40ac-aaeb-44bb72ddee0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:26.046638 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d6bf9d0c-fd3b-40ac-aaeb-44bb72ddee0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:26.047133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d6bf9d0c-fd3b-40ac-aaeb-44bb72ddee0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:26.047923 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d6bf9d0c-fd3b-40ac-aaeb-44bb72ddee0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:26.048396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d6bf9d0c-fd3b-40ac-aaeb-44bb72ddee0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:26.193757 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d6bf9d0c-fd3b-40ac-aaeb-44bb72ddee0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:26.202724 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d6bf9d0c-fd3b-40ac-aaeb-44bb72ddee0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.168135 Jun 08 13:54:26.203293 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 406/807] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:26 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:27.219091 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e284133e-fb2f-4af9-8d02-1c06775d6fce tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:27.220274 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e284133e-fb2f-4af9-8d02-1c06775d6fce tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:27.226996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e284133e-fb2f-4af9-8d02-1c06775d6fce tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:27.227542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e284133e-fb2f-4af9-8d02-1c06775d6fce tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:27.228500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e284133e-fb2f-4af9-8d02-1c06775d6fce tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:27.228941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e284133e-fb2f-4af9-8d02-1c06775d6fce tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:27.361413 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e284133e-fb2f-4af9-8d02-1c06775d6fce tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:27.370522 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e284133e-fb2f-4af9-8d02-1c06775d6fce tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.155283 Jun 08 13:54:27.371172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 402/808] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:27 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:28.388679 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a860bac3-2c92-444a-b85a-05e0fc9788a8 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:28.389331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a860bac3-2c92-444a-b85a-05e0fc9788a8 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:28.395961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a860bac3-2c92-444a-b85a-05e0fc9788a8 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:28.396463 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a860bac3-2c92-444a-b85a-05e0fc9788a8 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:28.398770 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a860bac3-2c92-444a-b85a-05e0fc9788a8 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:28.398770 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a860bac3-2c92-444a-b85a-05e0fc9788a8 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:28.534842 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a860bac3-2c92-444a-b85a-05e0fc9788a8 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:28.542932 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a860bac3-2c92-444a-b85a-05e0fc9788a8 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.159063 Jun 08 13:54:28.543547 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 407/809] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:28 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:29.561030 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e1e08c5b-38c2-4808-818b-d3452f1b2af9 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:29.561643 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e1e08c5b-38c2-4808-818b-d3452f1b2af9 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:29.568028 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1e08c5b-38c2-4808-818b-d3452f1b2af9 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:29.568509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1e08c5b-38c2-4808-818b-d3452f1b2af9 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:29.569270 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1e08c5b-38c2-4808-818b-d3452f1b2af9 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:29.569703 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e1e08c5b-38c2-4808-818b-d3452f1b2af9 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:29.701628 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e1e08c5b-38c2-4808-818b-d3452f1b2af9 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:29.710907 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e1e08c5b-38c2-4808-818b-d3452f1b2af9 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.153768 Jun 08 13:54:29.711485 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 403/810] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:29 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:54:30.728554 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-511c4d4d-d2d7-42af-9792-517059633b0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:30.731817 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-511c4d4d-d2d7-42af-9792-517059633b0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:30.736321 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-511c4d4d-d2d7-42af-9792-517059633b0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:30.736783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-511c4d4d-d2d7-42af-9792-517059633b0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:30.737574 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-511c4d4d-d2d7-42af-9792-517059633b0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:30.738020 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-511c4d4d-d2d7-42af-9792-517059633b0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:30.881121 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-511c4d4d-d2d7-42af-9792-517059633b0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:30.888705 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-511c4d4d-d2d7-42af-9792-517059633b0f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.164224 Jun 08 13:54:30.889270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 408/811] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:30 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:31.309451 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f523e9cd-d687-4ea1-b966-d3975ee0d475 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: .version_select at 0x7fe28992daf0>, body: {"keypair": {"name": "tempest-keypair-1397034832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwmPkF2gMp4ikC3jjX2z2OnVejbG7sw/C+gc9USXq1hKcPrVS4eRM8GUKa8JaWZ/QD7G6Qnt/baEKcJ/RHIz/5yL5ud5Eri2iD+GY0w1BrqYVZz6JrxSCjtcc5FvpcVXw=="}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:31.324377 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-f523e9cd-d687-4ea1-b966-d3975ee0d475 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:54:31.328178 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-f523e9cd-d687-4ea1-b966-d3975ee0d475 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for user e50a12d7facd4e4184d79bbac03bfa74 and project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:54:31.459492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f523e9cd-d687-4ea1-b966-d3975ee0d475 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153966 Jun 08 13:54:31.460041 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 404/812] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 13:54:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:54:31.906187 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c9a7c58d-b387-4786-b63e-97d3c706b3ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:31.906802 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c9a7c58d-b387-4786-b63e-97d3c706b3ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:31.912714 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c9a7c58d-b387-4786-b63e-97d3c706b3ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:31.913164 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c9a7c58d-b387-4786-b63e-97d3c706b3ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:31.913919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c9a7c58d-b387-4786-b63e-97d3c706b3ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:31.914361 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c9a7c58d-b387-4786-b63e-97d3c706b3ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:32.084260 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c9a7c58d-b387-4786-b63e-97d3c706b3ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:32.092289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c9a7c58d-b387-4786-b63e-97d3c706b3ec tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.190074 Jun 08 13:54:32.092934 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 409/813] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:31 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:33.110631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-194196b8-6073-407f-b07f-b76b0ce12db5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:33.112136 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-194196b8-6073-407f-b07f-b76b0ce12db5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:33.121521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-194196b8-6073-407f-b07f-b76b0ce12db5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:33.122293 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-194196b8-6073-407f-b07f-b76b0ce12db5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:33.123239 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-194196b8-6073-407f-b07f-b76b0ce12db5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:33.123921 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-194196b8-6073-407f-b07f-b76b0ce12db5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:33.305847 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-194196b8-6073-407f-b07f-b76b0ce12db5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:33.320178 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-194196b8-6073-407f-b07f-b76b0ce12db5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.213347 Jun 08 13:54:33.321135 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 405/814] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:33 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:34.187850 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1288527207", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8461b72-4585-42eb-adf7-269bbd08f24f"}], "security_groups": [{"name": "tempest-securitygroup--198990695"}], "key_name": "tempest-keypair-1397034832", "user_data": "}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:34.293063 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] validate_networks() for [('e8461b72-4585-42eb-adf7-269bbd08f24f', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:54:34.338267 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-cadac505-5e0c-4c39-936e-c687164e63e3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:34.338967 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-cadac505-5e0c-4c39-936e-c687164e63e3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:34.345869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cadac505-5e0c-4c39-936e-c687164e63e3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:34.346547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cadac505-5e0c-4c39-936e-c687164e63e3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:34.347431 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cadac505-5e0c-4c39-936e-c687164e63e3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:34.348001 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-cadac505-5e0c-4c39-936e-c687164e63e3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:34.544018 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-cadac505-5e0c-4c39-936e-c687164e63e3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:34.551586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-cadac505-5e0c-4c39-936e-c687164e63e3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1510 microversion: 2.1 time: 0.217900 Jun 08 13:54:34.552185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 406/815] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:34 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:54:34.568977 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-619f21a7-7b8e-4b50-a7fa-3abd4a58138f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:34.569625 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-619f21a7-7b8e-4b50-a7fa-3abd4a58138f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:34.576089 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-619f21a7-7b8e-4b50-a7fa-3abd4a58138f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:34.576561 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-619f21a7-7b8e-4b50-a7fa-3abd4a58138f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:34.578680 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-619f21a7-7b8e-4b50-a7fa-3abd4a58138f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:34.578680 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-619f21a7-7b8e-4b50-a7fa-3abd4a58138f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:34.740506 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:54:34.740961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:54:34.741635 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:54:34.742052 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:54:34.742501 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:54:34.753244 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:34.753702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:34.754517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:34.754989 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:34.772044 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:54:34.778363 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for user e50a12d7facd4e4184d79bbac03bfa74 and project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:54:34.789371 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:54:34.792930 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:54:34.861180 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-619f21a7-7b8e-4b50-a7fa-3abd4a58138f tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "POST /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45/action" status: 202 len: 0 microversion: 2.1 time: 0.296123 Jun 08 13:54:34.862160 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 407/816] 10.222.0.55 () {60 vars in 1277 bytes} [Wed Jun 8 13:54:34 2022] POST /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:54:34.870823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e5d45c1a-aaa1-4f67-81ac-370b7928bbf6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:34.871530 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e5d45c1a-aaa1-4f67-81ac-370b7928bbf6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:34.881224 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5d45c1a-aaa1-4f67-81ac-370b7928bbf6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:34.881224 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5d45c1a-aaa1-4f67-81ac-370b7928bbf6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:34.881224 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5d45c1a-aaa1-4f67-81ac-370b7928bbf6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:34.881224 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e5d45c1a-aaa1-4f67-81ac-370b7928bbf6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:34.910129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c3311bb0-e2d3-4b26-9498-5b881bb63884 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.726001 Jun 08 13:54:34.911051 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 410/817] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:54:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:54:34.921828 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f1b73be0-921c-49b6-bd9b-d16c65e19564 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:34.922455 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f1b73be0-921c-49b6-bd9b-d16c65e19564 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:35.028993 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f1b73be0-921c-49b6-bd9b-d16c65e19564 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:35.036695 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f1b73be0-921c-49b6-bd9b-d16c65e19564 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1242 microversion: 2.1 time: 0.118642 Jun 08 13:54:35.048304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 411/818] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:34 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:54:35.191134 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e5d45c1a-aaa1-4f67-81ac-370b7928bbf6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:35.199552 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e5d45c1a-aaa1-4f67-81ac-370b7928bbf6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1518 microversion: 2.1 time: 0.333269 Jun 08 13:54:35.200250 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 408/819] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:34 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1518 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:36.054864 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b6b4f6f2-d2f0-4373-92b0-ac7cda532017 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:36.057083 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b6b4f6f2-d2f0-4373-92b0-ac7cda532017 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:36.063772 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b6b4f6f2-d2f0-4373-92b0-ac7cda532017 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:36.064273 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b6b4f6f2-d2f0-4373-92b0-ac7cda532017 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:36.065059 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b6b4f6f2-d2f0-4373-92b0-ac7cda532017 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:36.065509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b6b4f6f2-d2f0-4373-92b0-ac7cda532017 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:36.134136 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b6b4f6f2-d2f0-4373-92b0-ac7cda532017 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:36.141607 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b6b4f6f2-d2f0-4373-92b0-ac7cda532017 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1246 microversion: 2.1 time: 0.090728 Jun 08 13:54:36.142222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 412/820] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:36 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:36.216604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b8ac86bd-6a74-4894-9ad2-d43bbb3a7202 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:36.217216 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b8ac86bd-6a74-4894-9ad2-d43bbb3a7202 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:36.224245 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b8ac86bd-6a74-4894-9ad2-d43bbb3a7202 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:36.224745 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b8ac86bd-6a74-4894-9ad2-d43bbb3a7202 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:36.225495 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b8ac86bd-6a74-4894-9ad2-d43bbb3a7202 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:36.226102 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b8ac86bd-6a74-4894-9ad2-d43bbb3a7202 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:36.339645 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-0f926e27-3d10-4a3b-9e6f-d9fa46db9683 req-d8987215-5660-44d3-a100-3084a25b9e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c573f844-d6af-4615-8cc2-191728d83c45", "name": "network-vif-unplugged", "status": "completed", "tag": "512f7b9f-3fb2-4819-b91a-7b166b591feb"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:36.352591 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-0f926e27-3d10-4a3b-9e6f-d9fa46db9683 req-d8987215-5660-44d3-a100-3084a25b9e9b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:36.353171 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-0f926e27-3d10-4a3b-9e6f-d9fa46db9683 req-d8987215-5660-44d3-a100-3084a25b9e9b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:36.368990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.compute.server_external_events [req-0f926e27-3d10-4a3b-9e6f-d9fa46db9683 req-d8987215-5660-44d3-a100-3084a25b9e9b service nova] Unable to find a host for instance c573f844-d6af-4615-8cc2-191728d83c45. Dropping event network-vif-unplugged {{(pid=124628) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 08 13:54:36.369999 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-0f926e27-3d10-4a3b-9e6f-d9fa46db9683 req-d8987215-5660-44d3-a100-3084a25b9e9b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036503 Jun 08 13:54:36.370995 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 413/821] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 08 13:54:36.434977 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b8ac86bd-6a74-4894-9ad2-d43bbb3a7202 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:36.434977 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b8ac86bd-6a74-4894-9ad2-d43bbb3a7202 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1520 microversion: 2.1 time: 0.213196 Jun 08 13:54:36.434977 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 409/822] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:36 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:37.159080 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6510fb5b-f2ac-4801-9e6e-3fb1f0be950e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:37.160681 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6510fb5b-f2ac-4801-9e6e-3fb1f0be950e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:37.168030 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6510fb5b-f2ac-4801-9e6e-3fb1f0be950e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:37.168694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6510fb5b-f2ac-4801-9e6e-3fb1f0be950e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:37.169553 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6510fb5b-f2ac-4801-9e6e-3fb1f0be950e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:37.170067 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6510fb5b-f2ac-4801-9e6e-3fb1f0be950e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:37.241998 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6510fb5b-f2ac-4801-9e6e-3fb1f0be950e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:37.250062 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6510fb5b-f2ac-4801-9e6e-3fb1f0be950e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1302 microversion: 2.1 time: 0.095116 Jun 08 13:54:37.250627 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 414/823] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:37 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:37.445065 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a0795653-1ab9-4319-b1ca-df6a264d0eb5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:37.446643 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a0795653-1ab9-4319-b1ca-df6a264d0eb5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:37.459377 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a0795653-1ab9-4319-b1ca-df6a264d0eb5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:37.459377 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a0795653-1ab9-4319-b1ca-df6a264d0eb5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:37.459377 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a0795653-1ab9-4319-b1ca-df6a264d0eb5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:37.459377 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a0795653-1ab9-4319-b1ca-df6a264d0eb5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:37.603296 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a0795653-1ab9-4319-b1ca-df6a264d0eb5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:37.612695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a0795653-1ab9-4319-b1ca-df6a264d0eb5 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1520 microversion: 2.1 time: 0.172419 Jun 08 13:54:37.613543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 410/824] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:37 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:38.272453 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-851c6899-383e-42b4-961c-34b7c0072e4a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:38.274342 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-851c6899-383e-42b4-961c-34b7c0072e4a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:38.281506 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-851c6899-383e-42b4-961c-34b7c0072e4a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:38.281950 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-851c6899-383e-42b4-961c-34b7c0072e4a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:38.282736 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-851c6899-383e-42b4-961c-34b7c0072e4a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:38.283182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-851c6899-383e-42b4-961c-34b7c0072e4a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:38.441732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-851c6899-383e-42b4-961c-34b7c0072e4a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:38.452765 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-851c6899-383e-42b4-961c-34b7c0072e4a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1367 microversion: 2.1 time: 0.184567 Jun 08 13:54:38.453973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 415/825] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:38 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:38.633881 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f45203eb-fbd0-49a6-afb9-066e896fedc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:38.634449 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f45203eb-fbd0-49a6-afb9-066e896fedc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:38.640952 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f45203eb-fbd0-49a6-afb9-066e896fedc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:38.644604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f45203eb-fbd0-49a6-afb9-066e896fedc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:38.644604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f45203eb-fbd0-49a6-afb9-066e896fedc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:38.644604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f45203eb-fbd0-49a6-afb9-066e896fedc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:38.790834 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f45203eb-fbd0-49a6-afb9-066e896fedc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:38.798695 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f45203eb-fbd0-49a6-afb9-066e896fedc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.168953 Jun 08 13:54:38.799303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 411/826] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:38 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:39.471284 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-84e999fc-7788-4bed-b65c-b4c7f3a31df9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:39.471946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-84e999fc-7788-4bed-b65c-b4c7f3a31df9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:39.479682 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84e999fc-7788-4bed-b65c-b4c7f3a31df9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:39.482876 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84e999fc-7788-4bed-b65c-b4c7f3a31df9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:39.482876 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84e999fc-7788-4bed-b65c-b4c7f3a31df9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:39.482876 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-84e999fc-7788-4bed-b65c-b4c7f3a31df9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:39.617349 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-84e999fc-7788-4bed-b65c-b4c7f3a31df9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:39.626197 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-84e999fc-7788-4bed-b65c-b4c7f3a31df9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1367 microversion: 2.1 time: 0.159228 Jun 08 13:54:39.626781 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 416/827] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:39 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:54:39.662550 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-4744787b-9a31-4626-a466-3b7dee6b0133 req-6d230a57-8bba-4bb3-93e7-d120d5443071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e5f2091-a20c-4030-8483-8ecc25d4cf9c", "tag": "a97697f1-e0f1-452f-a6b3-7e75911bfecf"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:39.679353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-4744787b-9a31-4626-a466-3b7dee6b0133 req-6d230a57-8bba-4bb3-93e7-d120d5443071 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:39.679353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-4744787b-9a31-4626-a466-3b7dee6b0133 req-6d230a57-8bba-4bb3-93e7-d120d5443071 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:39.695171 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-4744787b-9a31-4626-a466-3b7dee6b0133 req-6d230a57-8bba-4bb3-93e7-d120d5443071 service nova] Creating event network-changed:a97697f1-e0f1-452f-a6b3-7e75911bfecf for instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c on hv-cinder-81914 Jun 08 13:54:39.700809 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-4744787b-9a31-4626-a466-3b7dee6b0133 req-6d230a57-8bba-4bb3-93e7-d120d5443071 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041857 Jun 08 13:54:39.701412 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 412/828] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:54:39.816363 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-98b01af0-5625-46d9-9093-72b1809470c3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:39.816977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-98b01af0-5625-46d9-9093-72b1809470c3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:39.824262 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-98b01af0-5625-46d9-9093-72b1809470c3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:39.825060 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-98b01af0-5625-46d9-9093-72b1809470c3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:39.825844 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-98b01af0-5625-46d9-9093-72b1809470c3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:39.826286 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-98b01af0-5625-46d9-9093-72b1809470c3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:39.968227 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-98b01af0-5625-46d9-9093-72b1809470c3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:39.976240 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-98b01af0-5625-46d9-9093-72b1809470c3 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.163689 Jun 08 13:54:39.977518 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 417/829] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:39 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:40.645155 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a43e806d-2b43-4bf9-bd4a-b6b72d0832ba tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:40.645856 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a43e806d-2b43-4bf9-bd4a-b6b72d0832ba tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:40.652956 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a43e806d-2b43-4bf9-bd4a-b6b72d0832ba tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:40.653403 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a43e806d-2b43-4bf9-bd4a-b6b72d0832ba tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:40.654180 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a43e806d-2b43-4bf9-bd4a-b6b72d0832ba tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:40.654612 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a43e806d-2b43-4bf9-bd4a-b6b72d0832ba tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:40.787172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a43e806d-2b43-4bf9-bd4a-b6b72d0832ba tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:40.791235 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:40.795629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a43e806d-2b43-4bf9-bd4a-b6b72d0832ba tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1367 microversion: 2.1 time: 0.154698 Jun 08 13:54:40.796232 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 413/830] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:40 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:40.994821 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-11b4edd8-65c1-4344-a96c-2c41ff2d3012 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:40.995441 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-11b4edd8-65c1-4344-a96c-2c41ff2d3012 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:41.001906 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11b4edd8-65c1-4344-a96c-2c41ff2d3012 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:41.002356 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11b4edd8-65c1-4344-a96c-2c41ff2d3012 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:41.003153 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11b4edd8-65c1-4344-a96c-2c41ff2d3012 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:41.003594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11b4edd8-65c1-4344-a96c-2c41ff2d3012 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:41.138229 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-11b4edd8-65c1-4344-a96c-2c41ff2d3012 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:41.145745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-11b4edd8-65c1-4344-a96c-2c41ff2d3012 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.155637 Jun 08 13:54:41.146323 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 418/831] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:40 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:41.812928 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-54b04d02-a89a-4cf8-b940-0dfb9fbbe565 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:41.813546 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-54b04d02-a89a-4cf8-b940-0dfb9fbbe565 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:41.815413 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=4 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:41.822100 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-54b04d02-a89a-4cf8-b940-0dfb9fbbe565 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:41.829565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-54b04d02-a89a-4cf8-b940-0dfb9fbbe565 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:41.829565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-54b04d02-a89a-4cf8-b940-0dfb9fbbe565 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:41.829565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-54b04d02-a89a-4cf8-b940-0dfb9fbbe565 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:41.950652 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-54b04d02-a89a-4cf8-b940-0dfb9fbbe565 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:41.957800 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-54b04d02-a89a-4cf8-b940-0dfb9fbbe565 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1367 microversion: 2.1 time: 0.149191 Jun 08 13:54:41.958361 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 414/832] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:41 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:42.163594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f3126a57-7583-4fdb-99dd-c82dbf96ccc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:42.164783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f3126a57-7583-4fdb-99dd-c82dbf96ccc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:42.171213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f3126a57-7583-4fdb-99dd-c82dbf96ccc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:42.171673 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f3126a57-7583-4fdb-99dd-c82dbf96ccc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:42.172462 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f3126a57-7583-4fdb-99dd-c82dbf96ccc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:42.172902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f3126a57-7583-4fdb-99dd-c82dbf96ccc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:42.177264 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:42.301328 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f3126a57-7583-4fdb-99dd-c82dbf96ccc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:42.309289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f3126a57-7583-4fdb-99dd-c82dbf96ccc7 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.149611 Jun 08 13:54:42.309844 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 419/833] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:42 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:42.975243 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f40a90f5-4bd8-47bd-a3e8-057a1de747da tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:42.975786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f40a90f5-4bd8-47bd-a3e8-057a1de747da tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:42.982675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f40a90f5-4bd8-47bd-a3e8-057a1de747da tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:42.983130 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f40a90f5-4bd8-47bd-a3e8-057a1de747da tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:42.983902 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f40a90f5-4bd8-47bd-a3e8-057a1de747da tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:42.984374 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f40a90f5-4bd8-47bd-a3e8-057a1de747da tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:43.116952 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f40a90f5-4bd8-47bd-a3e8-057a1de747da tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:43.125960 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f40a90f5-4bd8-47bd-a3e8-057a1de747da tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1367 microversion: 2.1 time: 0.154973 Jun 08 13:54:43.126540 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 415/834] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:42 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:43.326946 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8a0c4319-16fb-4bc0-9a99-ab46fb1aee3a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:43.327570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8a0c4319-16fb-4bc0-9a99-ab46fb1aee3a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:43.334251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8a0c4319-16fb-4bc0-9a99-ab46fb1aee3a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:43.334744 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8a0c4319-16fb-4bc0-9a99-ab46fb1aee3a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:43.335513 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8a0c4319-16fb-4bc0-9a99-ab46fb1aee3a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:43.336037 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8a0c4319-16fb-4bc0-9a99-ab46fb1aee3a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:43.471438 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8a0c4319-16fb-4bc0-9a99-ab46fb1aee3a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:43.479943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8a0c4319-16fb-4bc0-9a99-ab46fb1aee3a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.157222 Jun 08 13:54:43.485419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 420/835] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:43 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:44.143381 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-84839360-2228-402c-90f6-78653a765181 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:44.144636 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-84839360-2228-402c-90f6-78653a765181 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:44.151987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84839360-2228-402c-90f6-78653a765181 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:44.152799 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84839360-2228-402c-90f6-78653a765181 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:44.153692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84839360-2228-402c-90f6-78653a765181 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:44.154261 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84839360-2228-402c-90f6-78653a765181 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:44.293751 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-84839360-2228-402c-90f6-78653a765181 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:44.301360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-84839360-2228-402c-90f6-78653a765181 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1367 microversion: 2.1 time: 0.162395 Jun 08 13:54:44.301947 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 416/836] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:44 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:44.501714 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c90e8915-9c71-4d69-a517-867bad73f031 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:44.508408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c90e8915-9c71-4d69-a517-867bad73f031 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:44.509305 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c90e8915-9c71-4d69-a517-867bad73f031 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:44.509751 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c90e8915-9c71-4d69-a517-867bad73f031 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:44.510517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c90e8915-9c71-4d69-a517-867bad73f031 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:44.510952 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c90e8915-9c71-4d69-a517-867bad73f031 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:44.643362 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c90e8915-9c71-4d69-a517-867bad73f031 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:44.652713 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c90e8915-9c71-4d69-a517-867bad73f031 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.155013 Jun 08 13:54:44.653287 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 421/837] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:44 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:44.795066 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-c950b2c7-1489-432d-a94a-fa743e1af149 req-16d55348-14c2-4ceb-a0a2-313077749ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5f2091-a20c-4030-8483-8ecc25d4cf9c", "name": "network-vif-plugged", "status": "completed", "tag": "a97697f1-e0f1-452f-a6b3-7e75911bfecf"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:44.803207 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-c950b2c7-1489-432d-a94a-fa743e1af149 req-16d55348-14c2-4ceb-a0a2-313077749ebd service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:44.803663 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-c950b2c7-1489-432d-a94a-fa743e1af149 req-16d55348-14c2-4ceb-a0a2-313077749ebd service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:44.815434 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-c950b2c7-1489-432d-a94a-fa743e1af149 req-16d55348-14c2-4ceb-a0a2-313077749ebd service nova] Creating event network-vif-plugged:a97697f1-e0f1-452f-a6b3-7e75911bfecf for instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c on hv-cinder-81914 Jun 08 13:54:44.821943 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-c950b2c7-1489-432d-a94a-fa743e1af149 req-16d55348-14c2-4ceb-a0a2-313077749ebd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030197 Jun 08 13:54:44.822549 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 417/838] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:54:45.318753 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a0030a69-9e8c-451e-97a6-e0330537efd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:45.319370 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a0030a69-9e8c-451e-97a6-e0330537efd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:45.323894 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:45.323894 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=8 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:45.326797 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a0030a69-9e8c-451e-97a6-e0330537efd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:45.327250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a0030a69-9e8c-451e-97a6-e0330537efd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:45.328015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a0030a69-9e8c-451e-97a6-e0330537efd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:45.328480 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a0030a69-9e8c-451e-97a6-e0330537efd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:45.458466 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a0030a69-9e8c-451e-97a6-e0330537efd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:45.467336 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a0030a69-9e8c-451e-97a6-e0330537efd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1367 microversion: 2.1 time: 0.152562 Jun 08 13:54:45.467896 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 422/839] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:45 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:45.671887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f3fa5d98-a78b-4090-b859-74009e569cb1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:45.672607 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f3fa5d98-a78b-4090-b859-74009e569cb1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:45.678683 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3fa5d98-a78b-4090-b859-74009e569cb1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:45.679129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3fa5d98-a78b-4090-b859-74009e569cb1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:45.680509 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3fa5d98-a78b-4090-b859-74009e569cb1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:45.680944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f3fa5d98-a78b-4090-b859-74009e569cb1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:45.822581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f3fa5d98-a78b-4090-b859-74009e569cb1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:45.833462 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f3fa5d98-a78b-4090-b859-74009e569cb1 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.166244 Jun 08 13:54:45.841085 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 418/840] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:45 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:46.485289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-20c0ef7f-2f21-4224-98d8-f31708a6ac58 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:46.485900 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-20c0ef7f-2f21-4224-98d8-f31708a6ac58 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:46.493481 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20c0ef7f-2f21-4224-98d8-f31708a6ac58 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:46.495208 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20c0ef7f-2f21-4224-98d8-f31708a6ac58 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:46.495208 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20c0ef7f-2f21-4224-98d8-f31708a6ac58 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:46.495208 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20c0ef7f-2f21-4224-98d8-f31708a6ac58 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:46.625575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-20c0ef7f-2f21-4224-98d8-f31708a6ac58 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:46.635022 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-20c0ef7f-2f21-4224-98d8-f31708a6ac58 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1367 microversion: 2.1 time: 0.153995 Jun 08 13:54:46.635609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 423/841] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:46 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:46.857295 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1917f0a8-a45b-4405-ba23-fcd784be3030 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:46.857845 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1917f0a8-a45b-4405-ba23-fcd784be3030 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:46.864521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1917f0a8-a45b-4405-ba23-fcd784be3030 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:46.864978 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1917f0a8-a45b-4405-ba23-fcd784be3030 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:46.865753 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1917f0a8-a45b-4405-ba23-fcd784be3030 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:46.866195 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1917f0a8-a45b-4405-ba23-fcd784be3030 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:47.001997 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1917f0a8-a45b-4405-ba23-fcd784be3030 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:47.010131 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1917f0a8-a45b-4405-ba23-fcd784be3030 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.156811 Jun 08 13:54:47.010704 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 419/842] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:46 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:47.652736 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-6338578e-a01a-4189-a75a-39897ab468d4 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:47.653499 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-6338578e-a01a-4189-a75a-39897ab468d4 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:47.660018 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6338578e-a01a-4189-a75a-39897ab468d4 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:47.660595 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6338578e-a01a-4189-a75a-39897ab468d4 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:47.661435 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6338578e-a01a-4189-a75a-39897ab468d4 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:47.661943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-6338578e-a01a-4189-a75a-39897ab468d4 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:47.793172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-6338578e-a01a-4189-a75a-39897ab468d4 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:47.800702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-6338578e-a01a-4189-a75a-39897ab468d4 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1557 microversion: 2.1 time: 0.152712 Jun 08 13:54:47.801272 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 424/843] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:47 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:47.817076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-877420cb-e402-4041-a013-53756a4e11e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:47.817575 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-877420cb-e402-4041-a013-53756a4e11e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:47.823669 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-877420cb-e402-4041-a013-53756a4e11e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:47.824152 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-877420cb-e402-4041-a013-53756a4e11e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:47.824916 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-877420cb-e402-4041-a013-53756a4e11e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:47.825348 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-877420cb-e402-4041-a013-53756a4e11e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:47.902983 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-877420cb-e402-4041-a013-53756a4e11e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089669 Jun 08 13:54:47.903577 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 420/844] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 8 13:54:47 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:54:48.027585 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-62095fd1-cd0d-45f2-a45c-4a56ba955ff6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:48.028242 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-62095fd1-cd0d-45f2-a45c-4a56ba955ff6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:48.034592 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-62095fd1-cd0d-45f2-a45c-4a56ba955ff6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:48.035049 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-62095fd1-cd0d-45f2-a45c-4a56ba955ff6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:48.035836 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-62095fd1-cd0d-45f2-a45c-4a56ba955ff6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:48.036304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-62095fd1-cd0d-45f2-a45c-4a56ba955ff6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:48.402080 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-62095fd1-cd0d-45f2-a45c-4a56ba955ff6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:48.409677 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-62095fd1-cd0d-45f2-a45c-4a56ba955ff6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.386682 Jun 08 13:54:48.410288 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 425/845] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:48 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:48.769796 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-d9f0bdc4-1765-4cdf-8279-a4965b511c44 req-7a021aa8-e964-4dd0-b379-232ec87e0337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c573f844-d6af-4615-8cc2-191728d83c45", "name": "network-vif-plugged", "status": "completed", "tag": "512f7b9f-3fb2-4819-b91a-7b166b591feb"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:48.785057 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-d9f0bdc4-1765-4cdf-8279-a4965b511c44 req-7a021aa8-e964-4dd0-b379-232ec87e0337 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:48.785057 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-d9f0bdc4-1765-4cdf-8279-a4965b511c44 req-7a021aa8-e964-4dd0-b379-232ec87e0337 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:48.790757 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-d9f0bdc4-1765-4cdf-8279-a4965b511c44 req-7a021aa8-e964-4dd0-b379-232ec87e0337 service nova] Creating event network-vif-plugged:512f7b9f-3fb2-4819-b91a-7b166b591feb for instance c573f844-d6af-4615-8cc2-191728d83c45 on hv-cinder-81914 Jun 08 13:54:48.796129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-d9f0bdc4-1765-4cdf-8279-a4965b511c44 req-7a021aa8-e964-4dd0-b379-232ec87e0337 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029975 Jun 08 13:54:48.796942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 421/846] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:54:49.294696 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-18bdc0ff-6659-4fdd-a64a-29b5f20ba121 req-e2a081dc-c2ea-4194-aadc-b51966bac8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e5f2091-a20c-4030-8483-8ecc25d4cf9c", "tag": "a97697f1-e0f1-452f-a6b3-7e75911bfecf"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:49.303334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-18bdc0ff-6659-4fdd-a64a-29b5f20ba121 req-e2a081dc-c2ea-4194-aadc-b51966bac8a8 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:49.303773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-18bdc0ff-6659-4fdd-a64a-29b5f20ba121 req-e2a081dc-c2ea-4194-aadc-b51966bac8a8 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:49.315396 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-18bdc0ff-6659-4fdd-a64a-29b5f20ba121 req-e2a081dc-c2ea-4194-aadc-b51966bac8a8 service nova] Creating event network-changed:a97697f1-e0f1-452f-a6b3-7e75911bfecf for instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c on hv-cinder-81914 Jun 08 13:54:49.320863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-18bdc0ff-6659-4fdd-a64a-29b5f20ba121 req-e2a081dc-c2ea-4194-aadc-b51966bac8a8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029933 Jun 08 13:54:49.321464 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 426/847] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:54:49.428333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1e527ae4-138a-4735-a198-d87df7aa6ab4 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:49.430188 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1e527ae4-138a-4735-a198-d87df7aa6ab4 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:49.444855 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e527ae4-138a-4735-a198-d87df7aa6ab4 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:49.446747 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e527ae4-138a-4735-a198-d87df7aa6ab4 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:49.447756 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e527ae4-138a-4735-a198-d87df7aa6ab4 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:49.448398 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1e527ae4-138a-4735-a198-d87df7aa6ab4 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:49.623069 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-1e527ae4-138a-4735-a198-d87df7aa6ab4 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:49.630673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1e527ae4-138a-4735-a198-d87df7aa6ab4 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.206944 Jun 08 13:54:49.631245 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 422/848] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:49 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:50.649152 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-36ad23f6-51f6-4bb1-a933-74e5af599751 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:50.649855 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-36ad23f6-51f6-4bb1-a933-74e5af599751 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:50.651838 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:50.656787 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-36ad23f6-51f6-4bb1-a933-74e5af599751 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:50.657236 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-36ad23f6-51f6-4bb1-a933-74e5af599751 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:50.657997 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-36ad23f6-51f6-4bb1-a933-74e5af599751 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:50.658428 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-36ad23f6-51f6-4bb1-a933-74e5af599751 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:50.813053 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-36ad23f6-51f6-4bb1-a933-74e5af599751 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:50.823697 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-36ad23f6-51f6-4bb1-a933-74e5af599751 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1576 microversion: 2.1 time: 0.178084 Jun 08 13:54:50.823697 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 427/849] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:50 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:51.842303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c94834ff-5b53-4d85-825e-c8f26e07f02c tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:51.843243 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c94834ff-5b53-4d85-825e-c8f26e07f02c tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:51.849945 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c94834ff-5b53-4d85-825e-c8f26e07f02c tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:51.850418 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c94834ff-5b53-4d85-825e-c8f26e07f02c tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:51.851189 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c94834ff-5b53-4d85-825e-c8f26e07f02c tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:51.851838 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c94834ff-5b53-4d85-825e-c8f26e07f02c tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:51.983569 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c94834ff-5b53-4d85-825e-c8f26e07f02c tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:51.991687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c94834ff-5b53-4d85-825e-c8f26e07f02c tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1563 microversion: 2.1 time: 0.153343 Jun 08 13:54:51.992609 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 423/850] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:51 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:54.332935 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1938646911", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "networks": [{"uuid": "e4901fa2-eb13-41c7-b74e-bcfc886edcb7"}]}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:54.385507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] validate_networks() for [('e4901fa2-eb13-41c7-b74e-bcfc886edcb7', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:54:54.732605 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:54:54.733035 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:54:54.733512 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:54:54.733924 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:54:54.734337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:54:54.745731 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:54.746179 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:54.746980 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:54.747418 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:54.764203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Getting quotas for project b53d8ce8920c4eb886b75eff075c4404. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:54:54.768185 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Getting quotas for user 8e9e7271524e4bc69fa4e8c198ba0af2 and project b53d8ce8920c4eb886b75eff075c4404. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:54:54.779536 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:54:54.781803 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:54:54.937770 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a2f1833f-edc6-4b77-ba99-b2a10972c9c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608616 Jun 08 13:54:54.938328 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 428/851] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:54:54.949347 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4448e3e4-4d0f-4e28-8e5a-d08ce4e959a1 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:54.950000 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4448e3e4-4d0f-4e28-8e5a-d08ce4e959a1 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:54.954146 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:54:55.007020 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4448e3e4-4d0f-4e28-8e5a-d08ce4e959a1 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:55.014893 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4448e3e4-4d0f-4e28-8e5a-d08ce4e959a1 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1214 microversion: 2.1 time: 0.070584 Jun 08 13:54:55.015515 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 424/852] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:54 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:56.032507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9db187b1-aba7-4ee1-a76b-d29c858f9393 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:56.033266 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-9db187b1-aba7-4ee1-a76b-d29c858f9393 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:56.088550 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-9db187b1-aba7-4ee1-a76b-d29c858f9393 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:56.095463 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9db187b1-aba7-4ee1-a76b-d29c858f9393 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1214 microversion: 2.1 time: 0.067327 Jun 08 13:54:56.096732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 429/853] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:56 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:57.112719 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6a129115-99ea-489e-95d3-2a2f618dff0e tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:57.113356 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6a129115-99ea-489e-95d3-2a2f618dff0e tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:57.121749 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6a129115-99ea-489e-95d3-2a2f618dff0e tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:57.122191 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6a129115-99ea-489e-95d3-2a2f618dff0e tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:57.122951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6a129115-99ea-489e-95d3-2a2f618dff0e tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:57.123385 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6a129115-99ea-489e-95d3-2a2f618dff0e tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:57.183489 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6a129115-99ea-489e-95d3-2a2f618dff0e tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:57.191004 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6a129115-99ea-489e-95d3-2a2f618dff0e tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1266 microversion: 2.1 time: 0.082063 Jun 08 13:54:57.191563 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 425/854] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:57 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:58.208320 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f506736f-04bf-4e10-8342-6c123967a54a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:58.209024 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f506736f-04bf-4e10-8342-6c123967a54a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:58.217425 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f506736f-04bf-4e10-8342-6c123967a54a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:58.217882 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f506736f-04bf-4e10-8342-6c123967a54a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:58.218669 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f506736f-04bf-4e10-8342-6c123967a54a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:58.219116 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f506736f-04bf-4e10-8342-6c123967a54a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:58.349555 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f506736f-04bf-4e10-8342-6c123967a54a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:58.358272 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f506736f-04bf-4e10-8342-6c123967a54a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1314 microversion: 2.1 time: 0.154104 Jun 08 13:54:58.358935 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 430/855] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:58 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:54:59.069068 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-b1f4c68f-8361-4de2-8cab-74e97fa50c09 req-89880134-e17c-4bc7-8a6e-c15400875362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425b8025-9d0a-4f63-8dc7-513ab38377ad", "tag": "c3fd9a1c-42ba-448f-8eb8-aa0d5be5cee0"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:54:59.078204 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-b1f4c68f-8361-4de2-8cab-74e97fa50c09 req-89880134-e17c-4bc7-8a6e-c15400875362 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:59.078662 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-b1f4c68f-8361-4de2-8cab-74e97fa50c09 req-89880134-e17c-4bc7-8a6e-c15400875362 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:59.095802 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-b1f4c68f-8361-4de2-8cab-74e97fa50c09 req-89880134-e17c-4bc7-8a6e-c15400875362 service nova] Creating event network-changed:c3fd9a1c-42ba-448f-8eb8-aa0d5be5cee0 for instance 425b8025-9d0a-4f63-8dc7-513ab38377ad on hv-cinder-81914 Jun 08 13:54:59.100639 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-b1f4c68f-8361-4de2-8cab-74e97fa50c09 req-89880134-e17c-4bc7-8a6e-c15400875362 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035328 Jun 08 13:54:59.101913 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 426/856] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:54:59.375394 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4a29a882-9571-4c25-8462-a6c37b28273c tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:54:59.376015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4a29a882-9571-4c25-8462-a6c37b28273c tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:54:59.383513 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4a29a882-9571-4c25-8462-a6c37b28273c tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:59.383979 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4a29a882-9571-4c25-8462-a6c37b28273c tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:59.384796 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4a29a882-9571-4c25-8462-a6c37b28273c tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:54:59.385243 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4a29a882-9571-4c25-8462-a6c37b28273c tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:54:59.525786 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4a29a882-9571-4c25-8462-a6c37b28273c tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:54:59.530101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4a29a882-9571-4c25-8462-a6c37b28273c tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1314 microversion: 2.1 time: 0.158492 Jun 08 13:54:59.530621 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 431/857] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:54:59 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:00.549268 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d817681f-dd11-4954-978a-c7148f1a0e93 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:00.549976 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d817681f-dd11-4954-978a-c7148f1a0e93 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:00.558837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d817681f-dd11-4954-978a-c7148f1a0e93 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:00.559632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d817681f-dd11-4954-978a-c7148f1a0e93 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:00.560487 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d817681f-dd11-4954-978a-c7148f1a0e93 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:00.560936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d817681f-dd11-4954-978a-c7148f1a0e93 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:00.691184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d817681f-dd11-4954-978a-c7148f1a0e93 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:00.699640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d817681f-dd11-4954-978a-c7148f1a0e93 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1314 microversion: 2.1 time: 0.155218 Jun 08 13:55:00.700265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 427/858] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:00 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:01.717579 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b28a2114-017d-4f4c-a5b7-b13bd1ec0756 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:01.718136 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b28a2114-017d-4f4c-a5b7-b13bd1ec0756 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:01.724558 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b28a2114-017d-4f4c-a5b7-b13bd1ec0756 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:01.725019 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b28a2114-017d-4f4c-a5b7-b13bd1ec0756 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:01.725854 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b28a2114-017d-4f4c-a5b7-b13bd1ec0756 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:01.734616 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b28a2114-017d-4f4c-a5b7-b13bd1ec0756 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:01.870402 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b28a2114-017d-4f4c-a5b7-b13bd1ec0756 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:01.878207 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b28a2114-017d-4f4c-a5b7-b13bd1ec0756 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1314 microversion: 2.1 time: 0.164597 Jun 08 13:55:01.878895 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 432/859] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:01 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:02.896385 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4edf275a-2e29-4552-afba-09e037866df8 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:02.897064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4edf275a-2e29-4552-afba-09e037866df8 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:02.904463 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4edf275a-2e29-4552-afba-09e037866df8 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:02.904950 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4edf275a-2e29-4552-afba-09e037866df8 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:02.905709 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4edf275a-2e29-4552-afba-09e037866df8 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:02.906143 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4edf275a-2e29-4552-afba-09e037866df8 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:03.043925 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4edf275a-2e29-4552-afba-09e037866df8 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:03.051344 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4edf275a-2e29-4552-afba-09e037866df8 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1314 microversion: 2.1 time: 0.158864 Jun 08 13:55:03.051922 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 428/860] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:02 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:04.068652 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4971d1a7-75d6-40a2-9095-3fd1a7b97bb2 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:04.069344 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4971d1a7-75d6-40a2-9095-3fd1a7b97bb2 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:04.075887 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4971d1a7-75d6-40a2-9095-3fd1a7b97bb2 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:04.076391 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4971d1a7-75d6-40a2-9095-3fd1a7b97bb2 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:04.077154 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4971d1a7-75d6-40a2-9095-3fd1a7b97bb2 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:04.077588 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4971d1a7-75d6-40a2-9095-3fd1a7b97bb2 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:04.208961 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4971d1a7-75d6-40a2-9095-3fd1a7b97bb2 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:04.217010 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4971d1a7-75d6-40a2-9095-3fd1a7b97bb2 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1314 microversion: 2.1 time: 0.152219 Jun 08 13:55:04.218030 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 433/861] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:04 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:04.923330 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-dd90d327-392d-4d74-aff1-98f25e7223f7 req-5b5fcde0-8aeb-4d4a-858f-4d369c6f3eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425b8025-9d0a-4f63-8dc7-513ab38377ad", "name": "network-vif-plugged", "status": "completed", "tag": "c3fd9a1c-42ba-448f-8eb8-aa0d5be5cee0"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:04.933041 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-dd90d327-392d-4d74-aff1-98f25e7223f7 req-5b5fcde0-8aeb-4d4a-858f-4d369c6f3eda service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:04.933421 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-dd90d327-392d-4d74-aff1-98f25e7223f7 req-5b5fcde0-8aeb-4d4a-858f-4d369c6f3eda service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:04.944137 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-dd90d327-392d-4d74-aff1-98f25e7223f7 req-5b5fcde0-8aeb-4d4a-858f-4d369c6f3eda service nova] Creating event network-vif-plugged:c3fd9a1c-42ba-448f-8eb8-aa0d5be5cee0 for instance 425b8025-9d0a-4f63-8dc7-513ab38377ad on hv-cinder-81914 Jun 08 13:55:04.956319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-dd90d327-392d-4d74-aff1-98f25e7223f7 req-5b5fcde0-8aeb-4d4a-858f-4d369c6f3eda service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029832 Jun 08 13:55:04.956319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 429/862] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:05.235289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7c817d0d-bdb8-4a88-9a38-50028f79a014 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:05.235846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7c817d0d-bdb8-4a88-9a38-50028f79a014 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:05.237789 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:05.244629 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7c817d0d-bdb8-4a88-9a38-50028f79a014 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:05.245087 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7c817d0d-bdb8-4a88-9a38-50028f79a014 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:05.245862 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7c817d0d-bdb8-4a88-9a38-50028f79a014 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:05.246298 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7c817d0d-bdb8-4a88-9a38-50028f79a014 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:05.384656 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7c817d0d-bdb8-4a88-9a38-50028f79a014 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:05.392044 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7c817d0d-bdb8-4a88-9a38-50028f79a014 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1314 microversion: 2.1 time: 0.161106 Jun 08 13:55:05.392638 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 434/863] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:05 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:06.406871 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:06.411624 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-75184907-5ed1-4388-90a2-8f10b1601900 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:06.412368 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-75184907-5ed1-4388-90a2-8f10b1601900 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:06.418842 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-75184907-5ed1-4388-90a2-8f10b1601900 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:06.419319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-75184907-5ed1-4388-90a2-8f10b1601900 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:06.420107 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-75184907-5ed1-4388-90a2-8f10b1601900 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:06.420548 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-75184907-5ed1-4388-90a2-8f10b1601900 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:06.548911 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-75184907-5ed1-4388-90a2-8f10b1601900 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:06.557552 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-75184907-5ed1-4388-90a2-8f10b1601900 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1314 microversion: 2.1 time: 0.151624 Jun 08 13:55:06.562781 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 430/864] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:06 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:07.575499 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-92dd6611-a224-41ff-9d89-a73c23cb355b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:07.576192 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-92dd6611-a224-41ff-9d89-a73c23cb355b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:07.578009 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=8 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:07.583476 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-92dd6611-a224-41ff-9d89-a73c23cb355b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:07.583924 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-92dd6611-a224-41ff-9d89-a73c23cb355b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:07.591885 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-92dd6611-a224-41ff-9d89-a73c23cb355b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:07.591885 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-92dd6611-a224-41ff-9d89-a73c23cb355b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:07.717414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-92dd6611-a224-41ff-9d89-a73c23cb355b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:07.725963 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-92dd6611-a224-41ff-9d89-a73c23cb355b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1498 microversion: 2.1 time: 0.153795 Jun 08 13:55:07.726573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 435/865] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:07 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:08.794871 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-378c419f-2e3f-4749-b898-0c18be573652 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:08.795402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-378c419f-2e3f-4749-b898-0c18be573652 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:08.801825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-378c419f-2e3f-4749-b898-0c18be573652 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:08.802271 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-378c419f-2e3f-4749-b898-0c18be573652 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:08.803027 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-378c419f-2e3f-4749-b898-0c18be573652 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:08.803496 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-378c419f-2e3f-4749-b898-0c18be573652 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:08.827375 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-378c419f-2e3f-4749-b898-0c18be573652 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:55:09.193712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-378c419f-2e3f-4749-b898-0c18be573652 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "DELETE /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 204 len: 0 microversion: 2.1 time: 0.402322 Jun 08 13:55:09.194980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 431/866] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:55:08 2022] DELETE /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:55:09.207634 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d2a4f809-3d7f-4278-82af-f03d6ce36358 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:09.208300 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d2a4f809-3d7f-4278-82af-f03d6ce36358 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:09.218326 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d2a4f809-3d7f-4278-82af-f03d6ce36358 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:09.224026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d2a4f809-3d7f-4278-82af-f03d6ce36358 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:09.224026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d2a4f809-3d7f-4278-82af-f03d6ce36358 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:09.224026 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d2a4f809-3d7f-4278-82af-f03d6ce36358 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:09.353681 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d2a4f809-3d7f-4278-82af-f03d6ce36358 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:09.361084 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d2a4f809-3d7f-4278-82af-f03d6ce36358 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1504 microversion: 2.1 time: 0.159012 Jun 08 13:55:09.361650 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 436/867] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:09 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:10.379507 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3f30f5ba-dac8-4df5-9935-01720e50219a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:10.380156 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3f30f5ba-dac8-4df5-9935-01720e50219a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:10.386614 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3f30f5ba-dac8-4df5-9935-01720e50219a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:10.387058 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3f30f5ba-dac8-4df5-9935-01720e50219a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:10.387815 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3f30f5ba-dac8-4df5-9935-01720e50219a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:10.388273 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3f30f5ba-dac8-4df5-9935-01720e50219a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:10.523412 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3f30f5ba-dac8-4df5-9935-01720e50219a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:10.526892 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:10.531143 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3f30f5ba-dac8-4df5-9935-01720e50219a tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1504 microversion: 2.1 time: 0.156009 Jun 08 13:55:10.535722 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 432/868] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:10 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:11.202701 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-561c1188-0958-408d-8949-67e1028a9611 req-055875b4-1428-4cb2-82b9-f12e54e8a9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425b8025-9d0a-4f63-8dc7-513ab38377ad", "name": "network-vif-deleted", "tag": "c3fd9a1c-42ba-448f-8eb8-aa0d5be5cee0"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:11.212036 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-561c1188-0958-408d-8949-67e1028a9611 req-055875b4-1428-4cb2-82b9-f12e54e8a9c1 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:11.214928 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-561c1188-0958-408d-8949-67e1028a9611 req-055875b4-1428-4cb2-82b9-f12e54e8a9c1 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:11.223564 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-561c1188-0958-408d-8949-67e1028a9611 req-055875b4-1428-4cb2-82b9-f12e54e8a9c1 service nova] Creating event network-vif-deleted:c3fd9a1c-42ba-448f-8eb8-aa0d5be5cee0 for instance 425b8025-9d0a-4f63-8dc7-513ab38377ad on hv-cinder-81914 Jun 08 13:55:11.229193 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-561c1188-0958-408d-8949-67e1028a9611 req-055875b4-1428-4cb2-82b9-f12e54e8a9c1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030320 Jun 08 13:55:11.229762 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 437/869] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:11.549844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:11.550411 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:11.557999 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:11.558451 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:11.559221 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:11.559652 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:11.591235 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:11.591806 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:11.592307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lazy-loading 'fault' on Instance uuid 425b8025-9d0a-4f63-8dc7-513ab38377ad {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:55:11.635176 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:11.642594 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-82c56485-0187-4608-93c7-9f239cd6c917 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 200 len: 1304 microversion: 2.1 time: 0.097390 Jun 08 13:55:11.643168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 433/870] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:11 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:12.660815 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:12.661523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: 425b8025-9d0a-4f63-8dc7-513ab38377ad] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:12.668509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:12.674136 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:12.674136 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:12.674136 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:12.683270 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] HTTP exception thrown: Instance 425b8025-9d0a-4f63-8dc7-513ab38377ad could not be found. Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Request method failure captured: Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad HTTP/1.1 Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKosCKNdbnUiFldZC0wVUsl5cMYAmk_AhNUij7X2RKORyLY-8WUCLksbIgVUhUhTqH_x62kChc0Z6BER7SdF--oXc8Wh1gjBOC97EfCShppGEBbxF0m3k0BoF3PIevX75_FQKR3NzAry7ta_HvnuNXbAOic77RqDq2ahLum-oxPw_ac Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: b53d8ce8920c4eb886b75eff075c4404 Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-VolumesActionsTest-1315045109 Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:55:12.684912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b53d8ce8920c4eb886b75eff075c4404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b53d8ce8920c4eb886b75eff075c4404", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b53d8ce8920c4eb886b75eff075c4404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b53d8ce8920c4eb886b75eff075c4404"}]}] Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-VolumesActionsTest-1315045109 Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: b53d8ce8920c4eb886b75eff075c4404 Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-VolumesActionsTest-1315045109 Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-VolumesActionsTest-1315045109-project Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 8e9e7271524e4bc69fa4e8c198ba0af2 Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-VolumesActionsTest-1315045109-project Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 425b8025-9d0a-4f63-8dc7-513ab38377ad could not be found. Jun 08 13:55:12.686540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '425b8025-9d0a-4f63-8dc7-513ab38377ad'} Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425b8025-9d0a-4f63-8dc7-513ab38377ad could not be found. Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:55:12.687434 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425b8025-9d0a-4f63-8dc7-513ab38377ad could not be found. Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425b8025-9d0a-4f63-8dc7-513ab38377ad could not be found. Jun 08 13:55:12.688773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:12.689949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Returning 404 to user: Instance 425b8025-9d0a-4f63-8dc7-513ab38377ad could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:55:12.689949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-796128cb-ead0-4547-b4c2-43e4ebc86d72 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad" status: 404 len: 111 microversion: 2.1 time: 0.030329 Jun 08 13:55:12.689949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 438/871] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:12 2022] GET /compute/v2.1/servers/425b8025-9d0a-4f63-8dc7-513ab38377ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:55:12.734441 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1654371366", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "networks": [{"uuid": "e4901fa2-eb13-41c7-b74e-bcfc886edcb7"}]}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:12.785856 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] validate_networks() for [('e4901fa2-eb13-41c7-b74e-bcfc886edcb7', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:55:13.167547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:55:13.167951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:55:13.168461 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:55:13.168870 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:55:13.169279 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:55:13.178018 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:13.178712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:13.179513 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:13.179947 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:13.196361 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Getting quotas for project b53d8ce8920c4eb886b75eff075c4404. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:55:13.200190 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Getting quotas for user 8e9e7271524e4bc69fa4e8c198ba0af2 and project b53d8ce8920c4eb886b75eff075c4404. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:55:13.211508 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:55:13.213812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:55:13.373411 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4fdffb07-8b91-44b1-931e-6f9c0c4a1d1d tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642855 Jun 08 13:55:13.376169 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 434/872] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:55:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:55:13.384664 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-95ed3059-ac24-472e-a765-54cdf674d1a0 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:13.385522 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-95ed3059-ac24-472e-a765-54cdf674d1a0 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:13.439934 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-95ed3059-ac24-472e-a765-54cdf674d1a0 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:13.447432 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-95ed3059-ac24-472e-a765-54cdf674d1a0 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1214 microversion: 2.1 time: 0.066661 Jun 08 13:55:13.448016 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 439/873] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:13 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:55:14.465372 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b2502de8-d4ea-4175-976a-1ad8098021ed tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:14.466020 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b2502de8-d4ea-4175-976a-1ad8098021ed tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:14.476382 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b2502de8-d4ea-4175-976a-1ad8098021ed tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:14.476844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b2502de8-d4ea-4175-976a-1ad8098021ed tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:14.477629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b2502de8-d4ea-4175-976a-1ad8098021ed tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:14.478078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b2502de8-d4ea-4175-976a-1ad8098021ed tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:14.539051 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b2502de8-d4ea-4175-976a-1ad8098021ed tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:14.546447 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b2502de8-d4ea-4175-976a-1ad8098021ed tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1218 microversion: 2.1 time: 0.085529 Jun 08 13:55:14.547013 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 435/874] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:14 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:15.564809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-732864d4-e5d1-4bb8-90c8-fa3dacf152bb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:15.565493 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-732864d4-e5d1-4bb8-90c8-fa3dacf152bb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:15.573783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-732864d4-e5d1-4bb8-90c8-fa3dacf152bb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:15.583263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-732864d4-e5d1-4bb8-90c8-fa3dacf152bb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:15.583263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-732864d4-e5d1-4bb8-90c8-fa3dacf152bb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:15.583263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-732864d4-e5d1-4bb8-90c8-fa3dacf152bb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:15.583263 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=97 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:15.637937 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-732864d4-e5d1-4bb8-90c8-fa3dacf152bb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:15.645387 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-732864d4-e5d1-4bb8-90c8-fa3dacf152bb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1284 microversion: 2.1 time: 0.084584 Jun 08 13:55:15.646007 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 440/875] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:15 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:16.662846 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-695e652c-86e2-496f-bd77-1fa96747c662 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:16.663841 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-695e652c-86e2-496f-bd77-1fa96747c662 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:16.670661 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-695e652c-86e2-496f-bd77-1fa96747c662 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:16.671113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-695e652c-86e2-496f-bd77-1fa96747c662 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:16.671886 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-695e652c-86e2-496f-bd77-1fa96747c662 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:16.672536 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-695e652c-86e2-496f-bd77-1fa96747c662 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:16.812453 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-695e652c-86e2-496f-bd77-1fa96747c662 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:16.820500 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-695e652c-86e2-496f-bd77-1fa96747c662 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1314 microversion: 2.1 time: 0.161525 Jun 08 13:55:16.821480 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 436/876] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:16 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:17.255578 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-302be7b8-77c3-46f5-acfd-ae039f0fe9b7 req-a1204757-966a-4845-a160-ab30ce25ce0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ea1823-22e4-476a-bb4e-b33563f13b01", "tag": "282e0d0f-d8dd-4f42-97de-94271f74ab1c"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:17.265425 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-302be7b8-77c3-46f5-acfd-ae039f0fe9b7 req-a1204757-966a-4845-a160-ab30ce25ce0c service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:17.265918 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-302be7b8-77c3-46f5-acfd-ae039f0fe9b7 req-a1204757-966a-4845-a160-ab30ce25ce0c service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:17.277474 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-302be7b8-77c3-46f5-acfd-ae039f0fe9b7 req-a1204757-966a-4845-a160-ab30ce25ce0c service nova] Creating event network-changed:282e0d0f-d8dd-4f42-97de-94271f74ab1c for instance f2ea1823-22e4-476a-bb4e-b33563f13b01 on hv-cinder-81914 Jun 08 13:55:17.282417 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-302be7b8-77c3-46f5-acfd-ae039f0fe9b7 req-a1204757-966a-4845-a160-ab30ce25ce0c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031096 Jun 08 13:55:17.282948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 441/877] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:17.838478 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7e600841-1374-435f-8115-dee42818c862 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:17.839087 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7e600841-1374-435f-8115-dee42818c862 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:17.845966 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7e600841-1374-435f-8115-dee42818c862 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:17.846417 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7e600841-1374-435f-8115-dee42818c862 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:17.847184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7e600841-1374-435f-8115-dee42818c862 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:17.847624 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7e600841-1374-435f-8115-dee42818c862 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:17.979527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7e600841-1374-435f-8115-dee42818c862 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:17.987184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7e600841-1374-435f-8115-dee42818c862 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1314 microversion: 2.1 time: 0.153143 Jun 08 13:55:17.987770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 437/878] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:17 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:19.004989 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-55babe39-d145-47b6-9fc2-59e7a9b411fb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:19.005684 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-55babe39-d145-47b6-9fc2-59e7a9b411fb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:19.012850 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55babe39-d145-47b6-9fc2-59e7a9b411fb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:19.013298 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55babe39-d145-47b6-9fc2-59e7a9b411fb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:19.014054 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55babe39-d145-47b6-9fc2-59e7a9b411fb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:19.014490 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-55babe39-d145-47b6-9fc2-59e7a9b411fb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:19.148215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-55babe39-d145-47b6-9fc2-59e7a9b411fb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:19.155714 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-55babe39-d145-47b6-9fc2-59e7a9b411fb tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1314 microversion: 2.1 time: 0.154866 Jun 08 13:55:19.156312 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 442/879] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:18 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:20.172301 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0e838d3c-50bd-4871-8e40-c51b84a9920b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:20.172914 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0e838d3c-50bd-4871-8e40-c51b84a9920b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:20.179127 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0e838d3c-50bd-4871-8e40-c51b84a9920b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:20.179565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0e838d3c-50bd-4871-8e40-c51b84a9920b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:20.180343 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0e838d3c-50bd-4871-8e40-c51b84a9920b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:20.180774 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0e838d3c-50bd-4871-8e40-c51b84a9920b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:20.306797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0e838d3c-50bd-4871-8e40-c51b84a9920b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:20.314161 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0e838d3c-50bd-4871-8e40-c51b84a9920b tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1314 microversion: 2.1 time: 0.145925 Jun 08 13:55:20.314729 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 438/880] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:20 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:21.331271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9c145a37-9328-4382-82ac-8cc44b096e73 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:21.331866 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-9c145a37-9328-4382-82ac-8cc44b096e73 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:21.339328 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9c145a37-9328-4382-82ac-8cc44b096e73 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:21.339780 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9c145a37-9328-4382-82ac-8cc44b096e73 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:21.340754 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9c145a37-9328-4382-82ac-8cc44b096e73 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:21.341197 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9c145a37-9328-4382-82ac-8cc44b096e73 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:21.474484 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-9c145a37-9328-4382-82ac-8cc44b096e73 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:21.481941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9c145a37-9328-4382-82ac-8cc44b096e73 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1314 microversion: 2.1 time: 0.154962 Jun 08 13:55:21.482502 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 443/881] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:21 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:22.499580 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-05447481-07fd-4ed8-99c0-4db3857d2c35 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:22.500217 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-05447481-07fd-4ed8-99c0-4db3857d2c35 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:22.507214 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-05447481-07fd-4ed8-99c0-4db3857d2c35 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:22.507905 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-05447481-07fd-4ed8-99c0-4db3857d2c35 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:22.508698 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-05447481-07fd-4ed8-99c0-4db3857d2c35 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:22.509128 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-05447481-07fd-4ed8-99c0-4db3857d2c35 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:22.639151 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-05447481-07fd-4ed8-99c0-4db3857d2c35 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:22.646542 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-05447481-07fd-4ed8-99c0-4db3857d2c35 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1314 microversion: 2.1 time: 0.150910 Jun 08 13:55:22.647132 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 439/882] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:22 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:23.040132 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-a19f6e35-0670-4501-ae7b-25012f1a2feb req-261119a9-58f7-400f-a6ff-cae8957ee8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ea1823-22e4-476a-bb4e-b33563f13b01", "name": "network-vif-plugged", "status": "completed", "tag": "282e0d0f-d8dd-4f42-97de-94271f74ab1c"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:23.049143 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-a19f6e35-0670-4501-ae7b-25012f1a2feb req-261119a9-58f7-400f-a6ff-cae8957ee8f9 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:23.049595 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-a19f6e35-0670-4501-ae7b-25012f1a2feb req-261119a9-58f7-400f-a6ff-cae8957ee8f9 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:23.060591 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-a19f6e35-0670-4501-ae7b-25012f1a2feb req-261119a9-58f7-400f-a6ff-cae8957ee8f9 service nova] Creating event network-vif-plugged:282e0d0f-d8dd-4f42-97de-94271f74ab1c for instance f2ea1823-22e4-476a-bb4e-b33563f13b01 on hv-cinder-81914 Jun 08 13:55:23.065629 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-a19f6e35-0670-4501-ae7b-25012f1a2feb req-261119a9-58f7-400f-a6ff-cae8957ee8f9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029922 Jun 08 13:55:23.066273 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 444/883] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:23.662837 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3b4e72a4-725c-4b18-b0fe-a780c80794dd tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:23.663516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3b4e72a4-725c-4b18-b0fe-a780c80794dd tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:23.665414 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:23.666168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=6 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:23.671569 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b4e72a4-725c-4b18-b0fe-a780c80794dd tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:23.673278 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b4e72a4-725c-4b18-b0fe-a780c80794dd tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:23.673278 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b4e72a4-725c-4b18-b0fe-a780c80794dd tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:23.673278 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b4e72a4-725c-4b18-b0fe-a780c80794dd tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:23.804487 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3b4e72a4-725c-4b18-b0fe-a780c80794dd tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:23.812073 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3b4e72a4-725c-4b18-b0fe-a780c80794dd tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1314 microversion: 2.1 time: 0.153254 Jun 08 13:55:23.812651 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 440/884] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:23 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:24.827331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:24.831928 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a703cc24-e531-4493-ac62-5d8e80909600 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:24.832766 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a703cc24-e531-4493-ac62-5d8e80909600 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:24.835698 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:24.840787 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a703cc24-e531-4493-ac62-5d8e80909600 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:24.841250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a703cc24-e531-4493-ac62-5d8e80909600 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:24.842028 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a703cc24-e531-4493-ac62-5d8e80909600 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:24.842498 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a703cc24-e531-4493-ac62-5d8e80909600 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:24.979067 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a703cc24-e531-4493-ac62-5d8e80909600 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:24.986517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a703cc24-e531-4493-ac62-5d8e80909600 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1314 microversion: 2.1 time: 0.160117 Jun 08 13:55:24.988842 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 445/885] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:24 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:25.504742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7c36b8c3-4fbd-43ab-bd9b-bef3ff1ed053 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:25.505298 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7c36b8c3-4fbd-43ab-bd9b-bef3ff1ed053 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:25.512099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c36b8c3-4fbd-43ab-bd9b-bef3ff1ed053 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:25.512557 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c36b8c3-4fbd-43ab-bd9b-bef3ff1ed053 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:25.513334 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c36b8c3-4fbd-43ab-bd9b-bef3ff1ed053 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:25.513775 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c36b8c3-4fbd-43ab-bd9b-bef3ff1ed053 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:25.537496 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7c36b8c3-4fbd-43ab-bd9b-bef3ff1ed053 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c/ips" status: 200 len: 150 microversion: 2.1 time: 0.036683 Jun 08 13:55:25.538613 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 441/886] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:55:25 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:25.549338 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b42cc4d-fae5-4f91-aca4-4520258cce9a"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:25.550430 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:25.557510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:25.557989 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:25.558769 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:25.559228 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:25.639247 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Invalid volume: volume 9b42cc4d-fae5-4f91-aca4-4520258cce9a is already attached to instances: ec5f074e-36e2-487e-9c9f-b613edaa6bf0 Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: POST /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c/os-volume_attachments HTTP/1.1 Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 74 Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:55:25.641074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {"volumeAttachment": {"volumeId": "9b42cc4d-fae5-4f91-aca4-4520258cce9a"}} Jun 08 13:55:25.642720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Invalid volume: volume 9b42cc4d-fae5-4f91-aca4-4520258cce9a is already attached to instances: ec5f074e-36e2-487e-9c9f-b613edaa6bf0 Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'server_id': '5e5f2091-a20c-4030-8483-8ecc25d4cf9c', 'body': {'volumeAttachment': {'volumeId': '9b42cc4d-fae5-4f91-aca4-4520258cce9a'}}} Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9b42cc4d-fae5-4f91-aca4-4520258cce9a is already attached to instances: ec5f074e-36e2-487e-9c9f-b613edaa6bf0 Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:25.643811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9b42cc4d-fae5-4f91-aca4-4520258cce9a is already attached to instances: ec5f074e-36e2-487e-9c9f-b613edaa6bf0 Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:25.645304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:25.646912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:25.646912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:55:25.646912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:55:25.646912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9b42cc4d-fae5-4f91-aca4-4520258cce9a is already attached to instances: ec5f074e-36e2-487e-9c9f-b613edaa6bf0 Jun 08 13:55:25.646912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:25.646912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 400 to user: Invalid volume: volume 9b42cc4d-fae5-4f91-aca4-4520258cce9a is already attached to instances: ec5f074e-36e2-487e-9c9f-b613edaa6bf0 {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:55:25.646912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b4beffa1-eca7-4c61-8494-94d5ab54341d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097290 Jun 08 13:55:25.646912 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 446/887] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:55:25 2022] POST /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:55:25.651304 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9e29ea9e-e1c4-41f7-a765-3f65ef815632 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:25.651804 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9e29ea9e-e1c4-41f7-a765-3f65ef815632 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:25.657873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e29ea9e-e1c4-41f7-a765-3f65ef815632 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:25.658321 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e29ea9e-e1c4-41f7-a765-3f65ef815632 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:25.659115 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e29ea9e-e1c4-41f7-a765-3f65ef815632 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:25.659551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e29ea9e-e1c4-41f7-a765-3f65ef815632 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:25.686754 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9e29ea9e-e1c4-41f7-a765-3f65ef815632 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:55:25.994276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9e29ea9e-e1c4-41f7-a765-3f65ef815632 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 204 len: 0 microversion: 2.1 time: 0.346550 Jun 08 13:55:25.994910 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 442/888] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:55:25 2022] DELETE /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:55:26.002995 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-773c9293-176f-4a2f-a6a3-44e7e64a308c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:26.003625 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-773c9293-176f-4a2f-a6a3-44e7e64a308c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:26.003899 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bc3a7920-5f9e-4017-8b71-1de3d96962c9 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:26.004649 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bc3a7920-5f9e-4017-8b71-1de3d96962c9 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:26.010675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bc3a7920-5f9e-4017-8b71-1de3d96962c9 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:26.011128 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bc3a7920-5f9e-4017-8b71-1de3d96962c9 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:26.011413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-773c9293-176f-4a2f-a6a3-44e7e64a308c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:26.011883 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-773c9293-176f-4a2f-a6a3-44e7e64a308c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:26.012039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bc3a7920-5f9e-4017-8b71-1de3d96962c9 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:26.012372 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bc3a7920-5f9e-4017-8b71-1de3d96962c9 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:26.012686 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-773c9293-176f-4a2f-a6a3-44e7e64a308c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:26.013184 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-773c9293-176f-4a2f-a6a3-44e7e64a308c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:26.204109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-773c9293-176f-4a2f-a6a3-44e7e64a308c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:26.208082 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bc3a7920-5f9e-4017-8b71-1de3d96962c9 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:26.212338 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-773c9293-176f-4a2f-a6a3-44e7e64a308c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1682 microversion: 2.1 time: 0.213142 Jun 08 13:55:26.212911 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 447/889] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:25 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:55:26.217208 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bc3a7920-5f9e-4017-8b71-1de3d96962c9 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1499 microversion: 2.1 time: 0.217400 Jun 08 13:55:26.217799 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 443/890] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:25 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1499 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:55:27.064613 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4097015b-30b1-44d4-bda4-f3e8257732a7 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:27.065163 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4097015b-30b1-44d4-bda4-f3e8257732a7 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:27.072295 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4097015b-30b1-44d4-bda4-f3e8257732a7 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:27.072873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4097015b-30b1-44d4-bda4-f3e8257732a7 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:27.073726 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4097015b-30b1-44d4-bda4-f3e8257732a7 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:27.074169 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4097015b-30b1-44d4-bda4-f3e8257732a7 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:27.099924 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4097015b-30b1-44d4-bda4-f3e8257732a7 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Going to try to terminate instance {{(pid=124628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:55:27.229762 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fd53005b-2b9b-426c-9c49-54fdb759fa04 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:27.230417 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fd53005b-2b9b-426c-9c49-54fdb759fa04 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:27.232906 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:27.237810 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd53005b-2b9b-426c-9c49-54fdb759fa04 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:27.238339 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd53005b-2b9b-426c-9c49-54fdb759fa04 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:27.239185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd53005b-2b9b-426c-9c49-54fdb759fa04 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:27.239656 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fd53005b-2b9b-426c-9c49-54fdb759fa04 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:27.371128 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-fd53005b-2b9b-426c-9c49-54fdb759fa04 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:27.378664 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fd53005b-2b9b-426c-9c49-54fdb759fa04 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1682 microversion: 2.1 time: 0.153394 Jun 08 13:55:27.379273 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 444/891] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:27 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:55:27.394407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4097015b-30b1-44d4-bda4-f3e8257732a7 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 204 len: 0 microversion: 2.1 time: 0.333053 Jun 08 13:55:27.394994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 448/892] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:55:27 2022] DELETE /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:55:27.403814 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7662c550-a936-48eb-9a30-fae5d36f2446 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:27.404557 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7662c550-a936-48eb-9a30-fae5d36f2446 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:27.411252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7662c550-a936-48eb-9a30-fae5d36f2446 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:27.411705 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7662c550-a936-48eb-9a30-fae5d36f2446 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:27.413148 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7662c550-a936-48eb-9a30-fae5d36f2446 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:27.413602 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7662c550-a936-48eb-9a30-fae5d36f2446 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:27.543326 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7662c550-a936-48eb-9a30-fae5d36f2446 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:27.550990 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7662c550-a936-48eb-9a30-fae5d36f2446 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1505 microversion: 2.1 time: 0.151160 Jun 08 13:55:27.551642 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 445/893] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:27 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:28.396968 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-423b855e-6b2e-44f6-8da1-cfc57b9e1259 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:28.397661 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-423b855e-6b2e-44f6-8da1-cfc57b9e1259 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:28.404318 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-423b855e-6b2e-44f6-8da1-cfc57b9e1259 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:28.404774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-423b855e-6b2e-44f6-8da1-cfc57b9e1259 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:28.405569 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-423b855e-6b2e-44f6-8da1-cfc57b9e1259 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:28.406013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-423b855e-6b2e-44f6-8da1-cfc57b9e1259 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:28.539002 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-423b855e-6b2e-44f6-8da1-cfc57b9e1259 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:28.546560 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-423b855e-6b2e-44f6-8da1-cfc57b9e1259 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1682 microversion: 2.1 time: 0.154068 Jun 08 13:55:28.547139 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 449/894] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:28 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:28.567559 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-67283952-993a-4c2b-81c7-45486292c1c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:28.568211 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-67283952-993a-4c2b-81c7-45486292c1c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:28.574885 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-67283952-993a-4c2b-81c7-45486292c1c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:28.575336 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-67283952-993a-4c2b-81c7-45486292c1c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:28.576152 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-67283952-993a-4c2b-81c7-45486292c1c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:28.576598 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-67283952-993a-4c2b-81c7-45486292c1c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:28.704457 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-67283952-993a-4c2b-81c7-45486292c1c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:28.712203 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-67283952-993a-4c2b-81c7-45486292c1c6 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1505 microversion: 2.1 time: 0.148401 Jun 08 13:55:28.712821 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 446/895] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:28 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:29.564366 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bf2b8346-4adc-4cc9-b055-0a4d764c966a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:29.564978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bf2b8346-4adc-4cc9-b055-0a4d764c966a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:29.572274 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf2b8346-4adc-4cc9-b055-0a4d764c966a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:29.572726 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf2b8346-4adc-4cc9-b055-0a4d764c966a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:29.573491 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf2b8346-4adc-4cc9-b055-0a4d764c966a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:29.573925 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf2b8346-4adc-4cc9-b055-0a4d764c966a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:29.621643 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-cad919e6-c73b-446d-bbf6-f9755c076548 req-f702712b-4ef6-472d-b520-1e1bb0b19320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ea1823-22e4-476a-bb4e-b33563f13b01", "name": "network-vif-deleted", "tag": "282e0d0f-d8dd-4f42-97de-94271f74ab1c"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:29.635623 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-cad919e6-c73b-446d-bbf6-f9755c076548 req-f702712b-4ef6-472d-b520-1e1bb0b19320 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:29.636094 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-cad919e6-c73b-446d-bbf6-f9755c076548 req-f702712b-4ef6-472d-b520-1e1bb0b19320 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:29.645184 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bf2b8346-4adc-4cc9-b055-0a4d764c966a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:29.647732 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-cad919e6-c73b-446d-bbf6-f9755c076548 req-f702712b-4ef6-472d-b520-1e1bb0b19320 service nova] Creating event network-vif-deleted:282e0d0f-d8dd-4f42-97de-94271f74ab1c for instance f2ea1823-22e4-476a-bb4e-b33563f13b01 on hv-cinder-81914 Jun 08 13:55:29.652951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-cad919e6-c73b-446d-bbf6-f9755c076548 req-f702712b-4ef6-472d-b520-1e1bb0b19320 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034997 Jun 08 13:55:29.653129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bf2b8346-4adc-4cc9-b055-0a4d764c966a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1615 microversion: 2.1 time: 0.092515 Jun 08 13:55:29.653626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 450/896] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:29 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1615 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:29.653863 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 447/897] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:29.729962 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-664fb395-7a64-4232-9e10-41d817f979c4 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:29.730591 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-664fb395-7a64-4232-9e10-41d817f979c4 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:29.736705 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-664fb395-7a64-4232-9e10-41d817f979c4 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:29.737148 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-664fb395-7a64-4232-9e10-41d817f979c4 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:29.737911 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-664fb395-7a64-4232-9e10-41d817f979c4 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:29.738343 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-664fb395-7a64-4232-9e10-41d817f979c4 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:29.811671 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-664fb395-7a64-4232-9e10-41d817f979c4 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9e7271524e4bc69fa4e8c198ba0af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53d8ce8920c4eb886b75eff075c4404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:29.822149 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-664fb395-7a64-4232-9e10-41d817f979c4 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 200 len: 1463 microversion: 2.1 time: 0.096115 Jun 08 13:55:29.823161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 451/898] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:29 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 1463 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:30.672141 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:30.672516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:30.679343 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:30.680442 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:30.681453 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:30.682078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:30.718665 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:30.719799 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:30.720287 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lazy-loading 'fault' on Instance uuid 5e5f2091-a20c-4030-8483-8ecc25d4cf9c {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:55:30.766531 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:30.770037 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:30.775576 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2e29e9f3-0707-478e-a18f-cd2db5b1bbf9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 200 len: 1332 microversion: 2.1 time: 0.108557 Jun 08 13:55:30.776188 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 448/899] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:30 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:30.841160 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:30.841776 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] [instance: f2ea1823-22e4-476a-bb4e-b33563f13b01] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:30.849065 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:30.849523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:30.850414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:30.850902 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:30.864911 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] HTTP exception thrown: Instance f2ea1823-22e4-476a-bb4e-b33563f13b01 could not be found. Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Request method failure captured: Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 HTTP/1.1 Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKosCKNdbnUiFldZC0wVUsl5cMYAmk_AhNUij7X2RKORyLY-8WUCLksbIgVUhUhTqH_x62kChc0Z6BER7SdF--oXc8Wh1gjBOC97EfCShppGEBbxF0m3k0BoF3PIevX75_FQKR3NzAry7ta_HvnuNXbAOic77RqDq2ahLum-oxPw_ac Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: b53d8ce8920c4eb886b75eff075c4404 Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-VolumesActionsTest-1315045109 Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:55:30.866733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b53d8ce8920c4eb886b75eff075c4404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b53d8ce8920c4eb886b75eff075c4404", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b53d8ce8920c4eb886b75eff075c4404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b53d8ce8920c4eb886b75eff075c4404"}]}] Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-VolumesActionsTest-1315045109 Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: b53d8ce8920c4eb886b75eff075c4404 Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-VolumesActionsTest-1315045109 Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-VolumesActionsTest-1315045109-project Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: 8e9e7271524e4bc69fa4e8c198ba0af2 Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-VolumesActionsTest-1315045109-project Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance f2ea1823-22e4-476a-bb4e-b33563f13b01 could not be found. Jun 08 13:55:30.869346 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'f2ea1823-22e4-476a-bb4e-b33563f13b01'} Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ea1823-22e4-476a-bb4e-b33563f13b01 could not be found. Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:55:30.870122 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ea1823-22e4-476a-bb4e-b33563f13b01 could not be found. Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ea1823-22e4-476a-bb4e-b33563f13b01 could not be found. Jun 08 13:55:30.871368 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:30.872515 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] Returning 404 to user: Instance f2ea1823-22e4-476a-bb4e-b33563f13b01 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:55:30.872515 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8abd269d-aa31-46e2-b151-0acc2fed1a20 tempest-VolumesActionsTest-1315045109 tempest-VolumesActionsTest-1315045109-project] 10.222.0.55 "GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01" status: 404 len: 111 microversion: 2.1 time: 0.031427 Jun 08 13:55:30.872515 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 452/900] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:30 2022] GET /compute/v2.1/servers/f2ea1823-22e4-476a-bb4e-b33563f13b01 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:55:31.668811 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-5436543e-6a27-4775-a540-565250b50469 req-4d1aee3b-b036-41e7-a947-beaabbc87e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5f2091-a20c-4030-8483-8ecc25d4cf9c", "name": "network-vif-deleted", "tag": "a97697f1-e0f1-452f-a6b3-7e75911bfecf"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:31.677620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-5436543e-6a27-4775-a540-565250b50469 req-4d1aee3b-b036-41e7-a947-beaabbc87e7f service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:31.678368 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-5436543e-6a27-4775-a540-565250b50469 req-4d1aee3b-b036-41e7-a947-beaabbc87e7f service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:31.689236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-5436543e-6a27-4775-a540-565250b50469 req-4d1aee3b-b036-41e7-a947-beaabbc87e7f service nova] Creating event network-vif-deleted:a97697f1-e0f1-452f-a6b3-7e75911bfecf for instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c on hv-cinder-81914 Jun 08 13:55:31.694684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-5436543e-6a27-4775-a540-565250b50469 req-4d1aee3b-b036-41e7-a947-beaabbc87e7f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029396 Jun 08 13:55:31.695290 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 449/901] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:31.792998 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:31.793563 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:31.799768 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:31.800254 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:31.801017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:31.801451 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:31.815046 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c HTTP/1.1 Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:55:31.816590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:55:31.818268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '5e5f2091-a20c-4030-8483-8ecc25d4cf9c'} Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:55:31.819615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:55:31.820973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:55:31.822068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:55:31.822068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7737d017-641d-4995-9bb2-ad16f075e6b7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 404 len: 111 microversion: 2.1 time: 0.028893 Jun 08 13:55:31.822068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 453/902] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:31 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 13:55:31.828404 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4cc4ddd1-c039-4cc4-b043-9edc3132bbcf tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '.version_select at 0x7fe2895320d0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:31.921372 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4cc4ddd1-c039-4cc4-b043-9edc3132bbcf tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397034832" status: 202 len: 0 microversion: 2.1 time: 0.097532 Jun 08 13:55:31.921959 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 450/903] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 8 13:55:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397034832 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:55:32.969468 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-31e1a8a9-b2e1-42a1-a1b9-63979b4b6099 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:32.970234 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-31e1a8a9-b2e1-42a1-a1b9-63979b4b6099 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:32.977340 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31e1a8a9-b2e1-42a1-a1b9-63979b4b6099 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:32.977789 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31e1a8a9-b2e1-42a1-a1b9-63979b4b6099 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:32.978552 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31e1a8a9-b2e1-42a1-a1b9-63979b4b6099 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:32.978989 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-31e1a8a9-b2e1-42a1-a1b9-63979b4b6099 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:33.059100 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-31e1a8a9-b2e1-42a1-a1b9-63979b4b6099 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lazy-loading 'services' on Instance uuid ec5f074e-36e2-487e-9c9f-b613edaa6bf0 {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:55:33.256886 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-31e1a8a9-b2e1-42a1-a1b9-63979b4b6099 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments/9b42cc4d-fae5-4f91-aca4-4520258cce9a" status: 202 len: 0 microversion: 2.1 time: 0.290847 Jun 08 13:55:33.257681 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 454/904] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:55:32 2022] DELETE /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments/9b42cc4d-fae5-4f91-aca4-4520258cce9a => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:55:33.266507 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b4545875-ea4c-4192-af20-f1a8ce38455e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:33.267620 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b4545875-ea4c-4192-af20-f1a8ce38455e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:33.274347 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b4545875-ea4c-4192-af20-f1a8ce38455e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:33.274895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b4545875-ea4c-4192-af20-f1a8ce38455e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:33.275580 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b4545875-ea4c-4192-af20-f1a8ce38455e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:33.276009 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b4545875-ea4c-4192-af20-f1a8ce38455e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:33.308682 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b4545875-ea4c-4192-af20-f1a8ce38455e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 Jun 08 13:55:33.309303 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 451/905] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:55:33 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:55:34.322350 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-0f7d5e30-f7cf-4706-bcab-0e7216c5dbbd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:34.323437 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-0f7d5e30-f7cf-4706-bcab-0e7216c5dbbd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:34.329761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0f7d5e30-f7cf-4706-bcab-0e7216c5dbbd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:34.330218 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0f7d5e30-f7cf-4706-bcab-0e7216c5dbbd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:34.330990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0f7d5e30-f7cf-4706-bcab-0e7216c5dbbd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:34.331431 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-0f7d5e30-f7cf-4706-bcab-0e7216c5dbbd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:34.360827 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-0f7d5e30-f7cf-4706-bcab-0e7216c5dbbd tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Jun 08 13:55:34.361386 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 455/906] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:55:34 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:35.372602 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6f7fb078-10d1-4453-b135-3cf5a320f7c1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:35.373531 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6f7fb078-10d1-4453-b135-3cf5a320f7c1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:35.380263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6f7fb078-10d1-4453-b135-3cf5a320f7c1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:35.385475 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6f7fb078-10d1-4453-b135-3cf5a320f7c1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:35.385475 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6f7fb078-10d1-4453-b135-3cf5a320f7c1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:35.385475 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6f7fb078-10d1-4453-b135-3cf5a320f7c1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:35.412699 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6f7fb078-10d1-4453-b135-3cf5a320f7c1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Jun 08 13:55:35.413592 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 452/907] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:55:35 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:36.425074 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b17a9a6d-6db6-4f6b-996a-629f7aab2bd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:36.426981 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b17a9a6d-6db6-4f6b-996a-629f7aab2bd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:36.435310 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b17a9a6d-6db6-4f6b-996a-629f7aab2bd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:36.436239 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b17a9a6d-6db6-4f6b-996a-629f7aab2bd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:36.437324 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b17a9a6d-6db6-4f6b-996a-629f7aab2bd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:36.438020 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b17a9a6d-6db6-4f6b-996a-629f7aab2bd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:36.470732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b17a9a6d-6db6-4f6b-996a-629f7aab2bd5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049948 Jun 08 13:55:36.472127 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 456/908] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:55:36 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:55:36.537243 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e871b9af-67ab-4b05-a295-e587bae9ad0c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:36.538054 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e871b9af-67ab-4b05-a295-e587bae9ad0c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:36.545332 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e871b9af-67ab-4b05-a295-e587bae9ad0c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:36.546031 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e871b9af-67ab-4b05-a295-e587bae9ad0c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:36.546865 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e871b9af-67ab-4b05-a295-e587bae9ad0c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:36.547328 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e871b9af-67ab-4b05-a295-e587bae9ad0c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:36.577742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e871b9af-67ab-4b05-a295-e587bae9ad0c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:55:36.965773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e871b9af-67ab-4b05-a295-e587bae9ad0c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 204 len: 0 microversion: 2.1 time: 0.432323 Jun 08 13:55:36.966483 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 453/909] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:55:36 2022] DELETE /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:55:36.977298 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-10fe0b28-e27b-47bc-b74d-82c287588f9b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:36.978217 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-10fe0b28-e27b-47bc-b74d-82c287588f9b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:36.984949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-10fe0b28-e27b-47bc-b74d-82c287588f9b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:36.986956 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-10fe0b28-e27b-47bc-b74d-82c287588f9b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:36.986956 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-10fe0b28-e27b-47bc-b74d-82c287588f9b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:36.987409 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-10fe0b28-e27b-47bc-b74d-82c287588f9b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:36.990483 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:37.153873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-10fe0b28-e27b-47bc-b74d-82c287588f9b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:37.162247 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-10fe0b28-e27b-47bc-b74d-82c287588f9b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1681 microversion: 2.1 time: 0.191409 Jun 08 13:55:37.163846 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 457/910] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:36 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:55:38.183158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6f348862-3d9c-4357-a5bd-cf13d6597b42 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:38.183927 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6f348862-3d9c-4357-a5bd-cf13d6597b42 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:38.193334 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6f348862-3d9c-4357-a5bd-cf13d6597b42 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:38.194049 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6f348862-3d9c-4357-a5bd-cf13d6597b42 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:38.195832 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6f348862-3d9c-4357-a5bd-cf13d6597b42 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:38.196394 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6f348862-3d9c-4357-a5bd-cf13d6597b42 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:38.343261 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-6f348862-3d9c-4357-a5bd-cf13d6597b42 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:38.351678 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6f348862-3d9c-4357-a5bd-cf13d6597b42 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1681 microversion: 2.1 time: 0.174784 Jun 08 13:55:38.361247 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 454/911] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:38 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:39.369382 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8f7eb24e-d469-41d6-a204-1d260fe04b99 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:39.370108 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8f7eb24e-d469-41d6-a204-1d260fe04b99 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:39.377478 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f7eb24e-d469-41d6-a204-1d260fe04b99 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:39.377589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f7eb24e-d469-41d6-a204-1d260fe04b99 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:39.378343 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f7eb24e-d469-41d6-a204-1d260fe04b99 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:39.378782 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f7eb24e-d469-41d6-a204-1d260fe04b99 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:39.483304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8f7eb24e-d469-41d6-a204-1d260fe04b99 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:39.483304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8f7eb24e-d469-41d6-a204-1d260fe04b99 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1613 microversion: 2.1 time: 0.099964 Jun 08 13:55:39.483304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 458/912] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:39 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:39.768038 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-df63af7f-62c9-4cdc-9ac4-15709300eb02 req-cafb4782-682d-42c2-83de-315597356494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec5f074e-36e2-487e-9c9f-b613edaa6bf0", "name": "network-vif-deleted", "tag": "74879222-2c74-48ad-9499-8d5ec0700aa7"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:39.785469 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-df63af7f-62c9-4cdc-9ac4-15709300eb02 req-cafb4782-682d-42c2-83de-315597356494 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:39.786758 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-df63af7f-62c9-4cdc-9ac4-15709300eb02 req-cafb4782-682d-42c2-83de-315597356494 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:39.814207 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-df63af7f-62c9-4cdc-9ac4-15709300eb02 req-cafb4782-682d-42c2-83de-315597356494 service nova] Creating event network-vif-deleted:74879222-2c74-48ad-9499-8d5ec0700aa7 for instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 on hv-cinder-81914 Jun 08 13:55:39.821645 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-df63af7f-62c9-4cdc-9ac4-15709300eb02 req-cafb4782-682d-42c2-83de-315597356494 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063451 Jun 08 13:55:39.823076 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 455/913] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:40.484954 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:40.486160 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:40.494839 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:40.496978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:40.496978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:40.496978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:40.535680 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:40.536154 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:40.536832 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lazy-loading 'fault' on Instance uuid ec5f074e-36e2-487e-9c9f-b613edaa6bf0 {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:55:40.594164 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:40.606148 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-964a2c15-ee9f-4a55-b400-dba7beb33e31 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 200 len: 1331 microversion: 2.1 time: 0.125624 Jun 08 13:55:40.607066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 459/914] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:40 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:41.624610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:41.626119 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:41.634438 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:41.634896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:41.635722 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:41.636232 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:41.653877 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 HTTP/1.1 Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:55:41.655778 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:55:41.657455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'ec5f074e-36e2-487e-9c9f-b613edaa6bf0'} Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:55:41.658265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:55:41.659603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:55:41.662894 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:55:41.662894 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-da218bf3-a70b-45af-b6f0-fdc782c4320f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 404 len: 111 microversion: 2.1 time: 0.037040 Jun 08 13:55:41.662894 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 456/915] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:41 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:55:41.667728 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e6e8ec60-6f41-4eac-a14f-ea87b826e22a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '.version_select at 0x7fe289855430>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:41.791438 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e6e8ec60-6f41-4eac-a14f-ea87b826e22a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332402640" status: 202 len: 0 microversion: 2.1 time: 0.128904 Jun 08 13:55:41.792078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 460/916] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 8 13:55:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332402640 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:55:42.891887 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8276495d-1271-4e25-b975-27a1f2e052b5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: .version_select at 0x7fe289706820>, body: {"keypair": {"name": "tempest-keypair-1809543125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItRQpKaMhs1we3prMKplGH3qmQZOHfsYR54YL4h0X24pYM/GMEKKp7rdMQOr6rbL4trT/idhvaMugFBVoYRYuMxqsw+jku8mvJEf1E/SAJkCQhkr8N4BSX2ZB3g0BmNkQ=="}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:42.911057 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-8276495d-1271-4e25-b975-27a1f2e052b5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:55:42.915543 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-8276495d-1271-4e25-b975-27a1f2e052b5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for user e50a12d7facd4e4184d79bbac03bfa74 and project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:55:43.051997 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8276495d-1271-4e25-b975-27a1f2e052b5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164141 Jun 08 13:55:43.053610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 457/917] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 13:55:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:45.954257 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1186622329", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8461b72-4585-42eb-adf7-269bbd08f24f"}], "security_groups": [{"name": "tempest-securitygroup--1907442542"}], "key_name": "tempest-keypair-1809543125", "user_data": "}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:46.083105 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] validate_networks() for [('e8461b72-4585-42eb-adf7-269bbd08f24f', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:55:46.549080 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:55:46.550448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:55:46.550448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:55:46.550858 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:55:46.551271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:55:46.567974 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:46.571101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:46.571101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:46.571101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:46.588246 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:55:46.592330 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for user e50a12d7facd4e4184d79bbac03bfa74 and project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:55:46.606152 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:55:46.608522 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:55:46.760981 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f6c3a1a8-1cd9-4ee1-9e00-2447510422fb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.812506 Jun 08 13:55:46.762292 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 461/918] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:55:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:55:46.774444 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e7618cc9-f1ef-4781-ac22-abc6452ebad1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:46.775055 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e7618cc9-f1ef-4781-ac22-abc6452ebad1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:46.866183 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e7618cc9-f1ef-4781-ac22-abc6452ebad1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:46.877034 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e7618cc9-f1ef-4781-ac22-abc6452ebad1 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1242 microversion: 2.1 time: 0.107328 Jun 08 13:55:46.878267 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 458/919] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:46 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:47.897304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-533f0a3d-1f2e-434a-b1a3-2515b709cfce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:47.898620 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-533f0a3d-1f2e-434a-b1a3-2515b709cfce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:47.906126 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-533f0a3d-1f2e-434a-b1a3-2515b709cfce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:47.906576 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-533f0a3d-1f2e-434a-b1a3-2515b709cfce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:47.907375 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-533f0a3d-1f2e-434a-b1a3-2515b709cfce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:47.907806 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-533f0a3d-1f2e-434a-b1a3-2515b709cfce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:47.976272 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-533f0a3d-1f2e-434a-b1a3-2515b709cfce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:47.999007 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-533f0a3d-1f2e-434a-b1a3-2515b709cfce tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1246 microversion: 2.1 time: 0.108315 Jun 08 13:55:48.000702 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 462/920] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:47 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:49.018441 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7c54ca9f-f3f1-4134-8b6a-769a8b4a0f2c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:49.019930 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7c54ca9f-f3f1-4134-8b6a-769a8b4a0f2c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:49.026861 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c54ca9f-f3f1-4134-8b6a-769a8b4a0f2c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:49.027508 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c54ca9f-f3f1-4134-8b6a-769a8b4a0f2c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:49.028527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c54ca9f-f3f1-4134-8b6a-769a8b4a0f2c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:49.028964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7c54ca9f-f3f1-4134-8b6a-769a8b4a0f2c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:49.101772 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7c54ca9f-f3f1-4134-8b6a-769a8b4a0f2c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:49.110207 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7c54ca9f-f3f1-4134-8b6a-769a8b4a0f2c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1294 microversion: 2.1 time: 0.096454 Jun 08 13:55:49.120714 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 459/921] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:49 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:50.130614 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e0b5602a-f87b-45ec-9aed-bbd44f777325 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:50.137648 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e0b5602a-f87b-45ec-9aed-bbd44f777325 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:50.141887 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e0b5602a-f87b-45ec-9aed-bbd44f777325 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:50.142641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e0b5602a-f87b-45ec-9aed-bbd44f777325 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:50.143741 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e0b5602a-f87b-45ec-9aed-bbd44f777325 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:50.144442 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e0b5602a-f87b-45ec-9aed-bbd44f777325 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:50.324928 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e0b5602a-f87b-45ec-9aed-bbd44f777325 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:50.336980 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e0b5602a-f87b-45ec-9aed-bbd44f777325 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1368 microversion: 2.1 time: 0.212140 Jun 08 13:55:50.348538 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 463/922] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:50 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:51.359074 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b49782ef-3bbc-4913-bce4-d16fa4d3abdb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:51.359719 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b49782ef-3bbc-4913-bce4-d16fa4d3abdb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:51.371304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-b9988e80-e005-4d2e-a68d-4ed358690262 req-8558dbbb-6aa7-4b13-a137-a38463e20820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6803a856-e3c4-4bf7-b84e-7b2c36f70e4b", "tag": "f4366783-f7bb-4a0e-ac61-9afb4a1f3b65"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:51.378969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b49782ef-3bbc-4913-bce4-d16fa4d3abdb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:51.378969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b49782ef-3bbc-4913-bce4-d16fa4d3abdb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:51.378969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b49782ef-3bbc-4913-bce4-d16fa4d3abdb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:51.378969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b49782ef-3bbc-4913-bce4-d16fa4d3abdb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:51.379725 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-b9988e80-e005-4d2e-a68d-4ed358690262 req-8558dbbb-6aa7-4b13-a137-a38463e20820 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:51.380455 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-b9988e80-e005-4d2e-a68d-4ed358690262 req-8558dbbb-6aa7-4b13-a137-a38463e20820 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:51.403330 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-b9988e80-e005-4d2e-a68d-4ed358690262 req-8558dbbb-6aa7-4b13-a137-a38463e20820 service nova] Creating event network-changed:f4366783-f7bb-4a0e-ac61-9afb4a1f3b65 for instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b on hv-cinder-81914 Jun 08 13:55:51.410019 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-b9988e80-e005-4d2e-a68d-4ed358690262 req-8558dbbb-6aa7-4b13-a137-a38463e20820 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042752 Jun 08 13:55:51.420031 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 464/923] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:55:51.571930 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b49782ef-3bbc-4913-bce4-d16fa4d3abdb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:51.583424 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b49782ef-3bbc-4913-bce4-d16fa4d3abdb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1368 microversion: 2.1 time: 0.230398 Jun 08 13:55:51.593687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 460/924] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:51 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:52.602468 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1d15990b-ad35-4469-a627-acc22fac4b52 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:52.603268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1d15990b-ad35-4469-a627-acc22fac4b52 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:52.610500 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1d15990b-ad35-4469-a627-acc22fac4b52 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:52.611168 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1d15990b-ad35-4469-a627-acc22fac4b52 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:52.612203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1d15990b-ad35-4469-a627-acc22fac4b52 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:52.612641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1d15990b-ad35-4469-a627-acc22fac4b52 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:52.755607 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1d15990b-ad35-4469-a627-acc22fac4b52 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:52.764238 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1d15990b-ad35-4469-a627-acc22fac4b52 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1368 microversion: 2.1 time: 0.166346 Jun 08 13:55:52.764809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 465/925] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:52 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:53.782732 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a15fdc7a-d233-46df-8742-e165a64f7933 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:53.783359 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a15fdc7a-d233-46df-8742-e165a64f7933 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:53.791273 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a15fdc7a-d233-46df-8742-e165a64f7933 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:53.791731 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a15fdc7a-d233-46df-8742-e165a64f7933 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:53.792551 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a15fdc7a-d233-46df-8742-e165a64f7933 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:53.792996 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a15fdc7a-d233-46df-8742-e165a64f7933 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:53.933453 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a15fdc7a-d233-46df-8742-e165a64f7933 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:53.940868 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a15fdc7a-d233-46df-8742-e165a64f7933 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1368 microversion: 2.1 time: 0.162705 Jun 08 13:55:53.941436 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 461/926] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:53 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:54.958743 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d035d8b1-9bff-43c9-9828-c047c0a9b2ac tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:54.959306 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d035d8b1-9bff-43c9-9828-c047c0a9b2ac tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:54.961783 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:54.966756 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d035d8b1-9bff-43c9-9828-c047c0a9b2ac tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:54.976215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d035d8b1-9bff-43c9-9828-c047c0a9b2ac tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:54.976215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d035d8b1-9bff-43c9-9828-c047c0a9b2ac tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:54.976215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d035d8b1-9bff-43c9-9828-c047c0a9b2ac tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:55.101932 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d035d8b1-9bff-43c9-9828-c047c0a9b2ac tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:55.109944 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d035d8b1-9bff-43c9-9828-c047c0a9b2ac tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1368 microversion: 2.1 time: 0.155131 Jun 08 13:55:55.110672 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 466/927] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:54 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:56.126783 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4d408635-7b76-4bbd-bd75-99d07d948591 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:56.127400 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4d408635-7b76-4bbd-bd75-99d07d948591 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:56.134602 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4d408635-7b76-4bbd-bd75-99d07d948591 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:56.135053 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4d408635-7b76-4bbd-bd75-99d07d948591 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:56.135818 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4d408635-7b76-4bbd-bd75-99d07d948591 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:56.136304 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4d408635-7b76-4bbd-bd75-99d07d948591 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:56.267653 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4d408635-7b76-4bbd-bd75-99d07d948591 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:56.275380 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4d408635-7b76-4bbd-bd75-99d07d948591 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1368 microversion: 2.1 time: 0.152564 Jun 08 13:55:56.275940 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 462/928] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:56 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:57.293357 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-27defda3-a5ff-455b-8b3d-e5334417692a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:57.293948 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-27defda3-a5ff-455b-8b3d-e5334417692a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:57.296615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:57.297359 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=6 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:57.302358 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-27defda3-a5ff-455b-8b3d-e5334417692a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:57.302805 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-27defda3-a5ff-455b-8b3d-e5334417692a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:57.304435 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-27defda3-a5ff-455b-8b3d-e5334417692a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:57.305188 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-27defda3-a5ff-455b-8b3d-e5334417692a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:57.342998 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-9038813d-81e2-4c06-8184-eebcd4e59b8f req-9de5b159-f6da-4083-96b5-b0a9de061c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6803a856-e3c4-4bf7-b84e-7b2c36f70e4b", "name": "network-vif-plugged", "status": "completed", "tag": "f4366783-f7bb-4a0e-ac61-9afb4a1f3b65"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:55:57.352046 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=6 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:57.358636 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-9038813d-81e2-4c06-8184-eebcd4e59b8f req-9de5b159-f6da-4083-96b5-b0a9de061c16 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:57.358636 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-9038813d-81e2-4c06-8184-eebcd4e59b8f req-9de5b159-f6da-4083-96b5-b0a9de061c16 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:57.366801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-9038813d-81e2-4c06-8184-eebcd4e59b8f req-9de5b159-f6da-4083-96b5-b0a9de061c16 service nova] Creating event network-vif-plugged:f4366783-f7bb-4a0e-ac61-9afb4a1f3b65 for instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b on hv-cinder-81914 Jun 08 13:55:57.372046 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-9038813d-81e2-4c06-8184-eebcd4e59b8f req-9de5b159-f6da-4083-96b5-b0a9de061c16 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Jun 08 13:55:57.372701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 463/929] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:55:57.448336 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-27defda3-a5ff-455b-8b3d-e5334417692a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:57.456251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-27defda3-a5ff-455b-8b3d-e5334417692a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1368 microversion: 2.1 time: 0.166708 Jun 08 13:55:57.462158 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 467/930] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:57 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:58.474845 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a913df9d-d42f-4b5f-b09a-c973e338df2b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:58.475644 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a913df9d-d42f-4b5f-b09a-c973e338df2b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:58.478105 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:55:58.483759 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a913df9d-d42f-4b5f-b09a-c973e338df2b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:58.484259 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a913df9d-d42f-4b5f-b09a-c973e338df2b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:58.492206 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a913df9d-d42f-4b5f-b09a-c973e338df2b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:58.492206 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a913df9d-d42f-4b5f-b09a-c973e338df2b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:58.618432 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a913df9d-d42f-4b5f-b09a-c973e338df2b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:58.626031 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a913df9d-d42f-4b5f-b09a-c973e338df2b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1368 microversion: 2.1 time: 0.156314 Jun 08 13:55:58.626606 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 464/931] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:58 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:59.643774 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b465b3bd-eb0e-4611-8d14-912d829ef8c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:59.644477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b465b3bd-eb0e-4611-8d14-912d829ef8c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:59.651862 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b465b3bd-eb0e-4611-8d14-912d829ef8c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:59.652358 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b465b3bd-eb0e-4611-8d14-912d829ef8c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:59.653131 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b465b3bd-eb0e-4611-8d14-912d829ef8c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:59.653767 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b465b3bd-eb0e-4611-8d14-912d829ef8c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:59.785266 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b465b3bd-eb0e-4611-8d14-912d829ef8c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:55:59.792785 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b465b3bd-eb0e-4611-8d14-912d829ef8c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1558 microversion: 2.1 time: 0.153409 Jun 08 13:55:59.793359 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 468/932] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:55:59 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:55:59.809756 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0cf3c533-ead2-44d3-8e1f-3a81f40f28e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:55:59.815624 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0cf3c533-ead2-44d3-8e1f-3a81f40f28e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:55:59.816892 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0cf3c533-ead2-44d3-8e1f-3a81f40f28e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:59.817340 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0cf3c533-ead2-44d3-8e1f-3a81f40f28e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:59.818096 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0cf3c533-ead2-44d3-8e1f-3a81f40f28e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:55:59.819145 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0cf3c533-ead2-44d3-8e1f-3a81f40f28e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:55:59.898209 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0cf3c533-ead2-44d3-8e1f-3a81f40f28e8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092268 Jun 08 13:55:59.898804 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 465/933] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 8 13:55:59 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:00.884930 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-c2a8dcb3-c116-43c7-97b6-f0d2764d680e req-8388feec-b2de-4a43-812f-3881cc773d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6803a856-e3c4-4bf7-b84e-7b2c36f70e4b", "tag": "f4366783-f7bb-4a0e-ac61-9afb4a1f3b65"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:00.893266 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-c2a8dcb3-c116-43c7-97b6-f0d2764d680e req-8388feec-b2de-4a43-812f-3881cc773d9b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:00.893705 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-c2a8dcb3-c116-43c7-97b6-f0d2764d680e req-8388feec-b2de-4a43-812f-3881cc773d9b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:00.906064 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-c2a8dcb3-c116-43c7-97b6-f0d2764d680e req-8388feec-b2de-4a43-812f-3881cc773d9b service nova] Creating event network-changed:f4366783-f7bb-4a0e-ac61-9afb4a1f3b65 for instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b on hv-cinder-81914 Jun 08 13:56:00.911094 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-c2a8dcb3-c116-43c7-97b6-f0d2764d680e req-8388feec-b2de-4a43-812f-3881cc773d9b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030334 Jun 08 13:56:00.911744 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 469/934] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:09.543238 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fa78c9d6-df11-49e9-996c-ea186245859e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:09.543769 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fa78c9d6-df11-49e9-996c-ea186245859e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:09.547023 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-1270819e-db7e-4b29-a50d-5a0109bbc527 req-22bb55da-664e-4f85-8ab9-6426d6228b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c573f844-d6af-4615-8cc2-191728d83c45", "tag": "512f7b9f-3fb2-4819-b91a-7b166b591feb"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:09.555919 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-1270819e-db7e-4b29-a50d-5a0109bbc527 req-22bb55da-664e-4f85-8ab9-6426d6228b8b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:09.556650 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-1270819e-db7e-4b29-a50d-5a0109bbc527 req-22bb55da-664e-4f85-8ab9-6426d6228b8b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:09.557251 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fa78c9d6-df11-49e9-996c-ea186245859e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:09.557706 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fa78c9d6-df11-49e9-996c-ea186245859e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:09.558586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fa78c9d6-df11-49e9-996c-ea186245859e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:09.559036 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fa78c9d6-df11-49e9-996c-ea186245859e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:09.563392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:09.567827 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-1270819e-db7e-4b29-a50d-5a0109bbc527 req-22bb55da-664e-4f85-8ab9-6426d6228b8b service nova] Creating event network-changed:512f7b9f-3fb2-4819-b91a-7b166b591feb for instance c573f844-d6af-4615-8cc2-191728d83c45 on hv-cinder-81914 Jun 08 13:56:09.573575 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-1270819e-db7e-4b29-a50d-5a0109bbc527 req-22bb55da-664e-4f85-8ab9-6426d6228b8b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037217 Jun 08 13:56:09.574372 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 470/935] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:09.587217 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fa78c9d6-df11-49e9-996c-ea186245859e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:56:09.930892 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fa78c9d6-df11-49e9-996c-ea186245859e tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 204 len: 0 microversion: 2.1 time: 0.396077 Jun 08 13:56:09.931521 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 466/936] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:56:09 2022] DELETE /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:56:09.940517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a973cc33-b7a8-4ee4-99a1-bee71202156a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:09.941236 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a973cc33-b7a8-4ee4-99a1-bee71202156a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:09.948694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a973cc33-b7a8-4ee4-99a1-bee71202156a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:09.949154 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a973cc33-b7a8-4ee4-99a1-bee71202156a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:09.949932 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a973cc33-b7a8-4ee4-99a1-bee71202156a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:09.950565 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a973cc33-b7a8-4ee4-99a1-bee71202156a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:10.104425 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a973cc33-b7a8-4ee4-99a1-bee71202156a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:10.112287 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a973cc33-b7a8-4ee4-99a1-bee71202156a tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.176047 Jun 08 13:56:10.112866 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 471/937] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:09 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:56:11.131120 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0663a7e7-866b-48c8-b272-a1038bc62663 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:11.131945 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0663a7e7-866b-48c8-b272-a1038bc62663 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:11.139332 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0663a7e7-866b-48c8-b272-a1038bc62663 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:11.139794 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0663a7e7-866b-48c8-b272-a1038bc62663 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:11.140610 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0663a7e7-866b-48c8-b272-a1038bc62663 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:11.141050 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0663a7e7-866b-48c8-b272-a1038bc62663 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:11.296350 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-0663a7e7-866b-48c8-b272-a1038bc62663 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:11.307224 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0663a7e7-866b-48c8-b272-a1038bc62663 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1569 microversion: 2.1 time: 0.177122 Jun 08 13:56:11.307224 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 467/938] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:11 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:12.139589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-b84085b8-42c0-4d19-bebc-0ed895217aa5 req-f0d23afc-857c-4685-b344-6c3d0e86d32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c573f844-d6af-4615-8cc2-191728d83c45", "name": "network-vif-deleted", "tag": "512f7b9f-3fb2-4819-b91a-7b166b591feb"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:12.148455 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-b84085b8-42c0-4d19-bebc-0ed895217aa5 req-f0d23afc-857c-4685-b344-6c3d0e86d32d service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:12.148942 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-b84085b8-42c0-4d19-bebc-0ed895217aa5 req-f0d23afc-857c-4685-b344-6c3d0e86d32d service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:12.152791 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=70 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:12.160298 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-b84085b8-42c0-4d19-bebc-0ed895217aa5 req-f0d23afc-857c-4685-b344-6c3d0e86d32d service nova] Creating event network-vif-deleted:512f7b9f-3fb2-4819-b91a-7b166b591feb for instance c573f844-d6af-4615-8cc2-191728d83c45 on hv-cinder-81914 Jun 08 13:56:12.166027 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-b84085b8-42c0-4d19-bebc-0ed895217aa5 req-f0d23afc-857c-4685-b344-6c3d0e86d32d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030118 Jun 08 13:56:12.166607 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 472/939] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:12.320915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ea84a9fd-768b-4693-802d-03795f576d71 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:12.320915 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ea84a9fd-768b-4693-802d-03795f576d71 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:12.327221 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ea84a9fd-768b-4693-802d-03795f576d71 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:12.327698 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ea84a9fd-768b-4693-802d-03795f576d71 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:12.328489 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ea84a9fd-768b-4693-802d-03795f576d71 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:12.328921 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ea84a9fd-768b-4693-802d-03795f576d71 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:12.390945 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-ea84a9fd-768b-4693-802d-03795f576d71 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:12.399013 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ea84a9fd-768b-4693-802d-03795f576d71 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1220 microversion: 2.1 time: 0.082716 Jun 08 13:56:12.399570 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 468/940] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:12 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:56:13.417517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:13.418234 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:13.424975 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:13.425463 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:13.426240 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:13.426683 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:13.457681 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:13.458148 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:13.458598 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lazy-loading 'fault' on Instance uuid c573f844-d6af-4615-8cc2-191728d83c45 {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:56:13.504669 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e3c65a8b344e4e893c3ebf436ac660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708bec67bbb748b382b82cd0da768d5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:13.512876 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7608a9dc-07f2-4128-9087-5175a4f8e5c6 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 200 len: 1225 microversion: 2.1 time: 0.100731 Jun 08 13:56:13.513453 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 473/941] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:13 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:14.531211 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:14.531761 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] [instance: c573f844-d6af-4615-8cc2-191728d83c45] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:14.538760 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:14.539827 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:14.539827 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:14.540233 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:14.553456 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] HTTP exception thrown: Instance c573f844-d6af-4615-8cc2-191728d83c45 could not be found. Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Request method failure captured: Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 HTTP/1.1 Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKleCceJwF6pAQaEENcqvQ6wEou6RbA1jLPJ2skIU4l_0lKdn7G3QjClmBrxGlEwB2sKHv_fgiS85R8AFX79rSyAKLSasAI8M1dgrePxrhUdVxXKPDtNUfFCgYXFu0d2IesfG7_vQkHFGaWYBrgzPAr212_R81FBu86rjy2Z31OZg1s Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 708bec67bbb748b382b82cd0da768d5c Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-TestShelveInstance-1379544356 Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:56:14.555687 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/708bec67bbb748b382b82cd0da768d5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_708bec67bbb748b382b82cd0da768d5c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/708bec67bbb748b382b82cd0da768d5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/708bec67bbb748b382b82cd0da768d5c"}]}] Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-TestShelveInstance-1379544356 Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 708bec67bbb748b382b82cd0da768d5c Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-TestShelveInstance-1379544356 Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-TestShelveInstance-1379544356-project Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: 24e3c65a8b344e4e893c3ebf436ac660 Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-TestShelveInstance-1379544356-project Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance c573f844-d6af-4615-8cc2-191728d83c45 could not be found. Jun 08 13:56:14.557185 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'c573f844-d6af-4615-8cc2-191728d83c45'} Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c573f844-d6af-4615-8cc2-191728d83c45 could not be found. Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:56:14.558062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c573f844-d6af-4615-8cc2-191728d83c45 could not be found. Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c573f844-d6af-4615-8cc2-191728d83c45 could not be found. Jun 08 13:56:14.559595 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:14.561117 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Returning 404 to user: Instance c573f844-d6af-4615-8cc2-191728d83c45 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:56:14.561117 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-70b56184-88c0-4b7f-9d68-9bd4962d6cbe tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45" status: 404 len: 111 microversion: 2.1 time: 0.029904 Jun 08 13:56:14.561117 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 469/942] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:14 2022] GET /compute/v2.1/servers/c573f844-d6af-4615-8cc2-191728d83c45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:56:14.792718 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-75b4d761-11d1-4485-820c-8da6f8a79c35 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] Calling method '.version_select at 0x7fe28985a700>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:14.890993 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-75b4d761-11d1-4485-820c-8da6f8a79c35 tempest-TestShelveInstance-1379544356 tempest-TestShelveInstance-1379544356-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1972270106" status: 202 len: 0 microversion: 2.1 time: 0.102897 Jun 08 13:56:14.891577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 474/943] 10.222.0.55 () {58 vars in 1253 bytes} [Wed Jun 8 13:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1972270106 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:56:30.535627 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f0dc1a58-132d-4f3a-adde-25dc020b68a8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:30.536226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f0dc1a58-132d-4f3a-adde-25dc020b68a8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:30.538315 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:30.539039 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:30.544010 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f0dc1a58-132d-4f3a-adde-25dc020b68a8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:30.548474 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f0dc1a58-132d-4f3a-adde-25dc020b68a8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:30.548474 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f0dc1a58-132d-4f3a-adde-25dc020b68a8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:30.548474 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f0dc1a58-132d-4f3a-adde-25dc020b68a8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:30.568855 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f0dc1a58-132d-4f3a-adde-25dc020b68a8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/ips" status: 200 len: 149 microversion: 2.1 time: 0.037379 Jun 08 13:56:30.569427 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 470/944] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:56:30 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:32.394398 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=9 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:32.395153 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:56:32.400350 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-022e37ca-59da-460c-b879-c75eeb06d143 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c036780-df42-411d-a7ef-233e7e45fd50"}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:32.401421 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-022e37ca-59da-460c-b879-c75eeb06d143 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:32.408044 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-022e37ca-59da-460c-b879-c75eeb06d143 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:32.411139 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-022e37ca-59da-460c-b879-c75eeb06d143 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:32.411139 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-022e37ca-59da-460c-b879-c75eeb06d143 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:32.411139 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-022e37ca-59da-460c-b879-c75eeb06d143 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:33.253674 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-022e37ca-59da-460c-b879-c75eeb06d143 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860738 Jun 08 13:56:33.254285 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 475/945] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:56:32 2022] POST /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:40.743796 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c036780-df42-411d-a7ef-233e7e45fd50"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:40.744922 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:40.752547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:40.752989 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:40.753786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:40.754187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:41.031992 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Invalid volume: volume 4c036780-df42-411d-a7ef-233e7e45fd50 is already attached to instances: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: POST /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments HTTP/1.1 Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 74 Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:56:41.033629 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {"volumeAttachment": {"volumeId": "4c036780-df42-411d-a7ef-233e7e45fd50"}} Jun 08 13:56:41.035319 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Invalid volume: volume 4c036780-df42-411d-a7ef-233e7e45fd50 is already attached to instances: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'server_id': '6803a856-e3c4-4bf7-b84e-7b2c36f70e4b', 'body': {'volumeAttachment': {'volumeId': '4c036780-df42-411d-a7ef-233e7e45fd50'}}} Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4c036780-df42-411d-a7ef-233e7e45fd50 is already attached to instances: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:41.036333 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4c036780-df42-411d-a7ef-233e7e45fd50 is already attached to instances: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:56:41.037844 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:56:41.039402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:56:41.039402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:56:41.039402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:56:41.039402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4c036780-df42-411d-a7ef-233e7e45fd50 is already attached to instances: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b Jun 08 13:56:41.039402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:56:41.039402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 400 to user: Invalid volume: volume 4c036780-df42-411d-a7ef-233e7e45fd50 is already attached to instances: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:56:41.039402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3fc1cf2a-9522-4330-9542-3bdcfb45dfae tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.296204 Jun 08 13:56:41.039402 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 471/946] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:56:40 2022] POST /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments => generated 174 bytes in 297 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 08 13:56:41.096951 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1ad15ebd-0355-422d-8f61-ec0bb809cc2f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:41.097573 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1ad15ebd-0355-422d-8f61-ec0bb809cc2f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:41.103885 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1ad15ebd-0355-422d-8f61-ec0bb809cc2f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:41.104379 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1ad15ebd-0355-422d-8f61-ec0bb809cc2f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:41.105173 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1ad15ebd-0355-422d-8f61-ec0bb809cc2f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:41.105647 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1ad15ebd-0355-422d-8f61-ec0bb809cc2f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:41.239663 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-1ad15ebd-0355-422d-8f61-ec0bb809cc2f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lazy-loading 'services' on Instance uuid 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:56:41.455335 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1ad15ebd-0355-422d-8f61-ec0bb809cc2f tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments/4c036780-df42-411d-a7ef-233e7e45fd50" status: 202 len: 0 microversion: 2.1 time: 0.363430 Jun 08 13:56:41.455839 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 476/947] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:56:41 2022] DELETE /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments/4c036780-df42-411d-a7ef-233e7e45fd50 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 08 13:56:41.464386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f1955e6c-c68d-41f4-b74b-093e9e5292b8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:41.465366 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f1955e6c-c68d-41f4-b74b-093e9e5292b8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:41.471734 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1955e6c-c68d-41f4-b74b-093e9e5292b8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:41.472221 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1955e6c-c68d-41f4-b74b-093e9e5292b8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:41.473000 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1955e6c-c68d-41f4-b74b-093e9e5292b8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:41.473437 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f1955e6c-c68d-41f4-b74b-093e9e5292b8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:41.504487 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f1955e6c-c68d-41f4-b74b-093e9e5292b8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 Jun 08 13:56:41.505073 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 472/948] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:56:41 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:42.517299 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c2a65197-d882-481f-8dcb-1de1a7bac4bc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:42.518352 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c2a65197-d882-481f-8dcb-1de1a7bac4bc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:42.524633 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c2a65197-d882-481f-8dcb-1de1a7bac4bc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:42.525086 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c2a65197-d882-481f-8dcb-1de1a7bac4bc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:42.525855 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c2a65197-d882-481f-8dcb-1de1a7bac4bc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:42.526295 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c2a65197-d882-481f-8dcb-1de1a7bac4bc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:42.555794 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c2a65197-d882-481f-8dcb-1de1a7bac4bc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044230 Jun 08 13:56:42.556448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 477/949] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:56:42 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:56:42.616111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ef5e6e8c-41d3-4b3f-bbd9-bf637adcf4e9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:42.616615 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ef5e6e8c-41d3-4b3f-bbd9-bf637adcf4e9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:42.623796 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ef5e6e8c-41d3-4b3f-bbd9-bf637adcf4e9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:42.624283 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ef5e6e8c-41d3-4b3f-bbd9-bf637adcf4e9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:42.625052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ef5e6e8c-41d3-4b3f-bbd9-bf637adcf4e9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:42.625565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ef5e6e8c-41d3-4b3f-bbd9-bf637adcf4e9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:42.650627 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ef5e6e8c-41d3-4b3f-bbd9-bf637adcf4e9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:56:42.998936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ef5e6e8c-41d3-4b3f-bbd9-bf637adcf4e9 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 204 len: 0 microversion: 2.1 time: 0.386440 Jun 08 13:56:42.999528 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 473/950] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:56:42 2022] DELETE /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:56:43.007721 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3ee6bb58-9a86-422c-9546-da2a7757038d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:43.008372 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3ee6bb58-9a86-422c-9546-da2a7757038d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:43.015045 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3ee6bb58-9a86-422c-9546-da2a7757038d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:43.015494 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3ee6bb58-9a86-422c-9546-da2a7757038d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:43.016294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3ee6bb58-9a86-422c-9546-da2a7757038d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:43.016732 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3ee6bb58-9a86-422c-9546-da2a7757038d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:43.149298 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3ee6bb58-9a86-422c-9546-da2a7757038d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:43.157428 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3ee6bb58-9a86-422c-9546-da2a7757038d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1682 microversion: 2.1 time: 0.153747 Jun 08 13:56:43.158000 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 478/951] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:43 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:44.175567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8496593b-6171-4a1c-8ce8-6b48a60031c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:44.176264 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8496593b-6171-4a1c-8ce8-6b48a60031c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:44.182894 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8496593b-6171-4a1c-8ce8-6b48a60031c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:44.183350 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8496593b-6171-4a1c-8ce8-6b48a60031c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:44.184151 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8496593b-6171-4a1c-8ce8-6b48a60031c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:44.184730 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8496593b-6171-4a1c-8ce8-6b48a60031c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:44.318531 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8496593b-6171-4a1c-8ce8-6b48a60031c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:44.325965 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8496593b-6171-4a1c-8ce8-6b48a60031c3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1682 microversion: 2.1 time: 0.155111 Jun 08 13:56:44.330867 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 474/952] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:44 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:45.343186 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ffa45bf5-bc89-4f51-ba3a-9d3cac22f7d3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:45.343964 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ffa45bf5-bc89-4f51-ba3a-9d3cac22f7d3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:45.351703 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ffa45bf5-bc89-4f51-ba3a-9d3cac22f7d3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:45.352195 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ffa45bf5-bc89-4f51-ba3a-9d3cac22f7d3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:45.352990 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ffa45bf5-bc89-4f51-ba3a-9d3cac22f7d3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:45.353430 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ffa45bf5-bc89-4f51-ba3a-9d3cac22f7d3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:45.361336 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-20e471f2-078b-46fc-afcb-aa2150adf8ee req-f003b6f3-a880-4b6a-89f7-5faa6002cf71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6803a856-e3c4-4bf7-b84e-7b2c36f70e4b", "name": "network-vif-deleted", "tag": "f4366783-f7bb-4a0e-ac61-9afb4a1f3b65"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:45.372804 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-20e471f2-078b-46fc-afcb-aa2150adf8ee req-f003b6f3-a880-4b6a-89f7-5faa6002cf71 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:45.373406 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-20e471f2-078b-46fc-afcb-aa2150adf8ee req-f003b6f3-a880-4b6a-89f7-5faa6002cf71 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:45.386733 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-20e471f2-078b-46fc-afcb-aa2150adf8ee req-f003b6f3-a880-4b6a-89f7-5faa6002cf71 service nova] Creating event network-vif-deleted:f4366783-f7bb-4a0e-ac61-9afb4a1f3b65 for instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b on hv-cinder-81914 Jun 08 13:56:45.393429 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-20e471f2-078b-46fc-afcb-aa2150adf8ee req-f003b6f3-a880-4b6a-89f7-5faa6002cf71 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040544 Jun 08 13:56:45.394617 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 475/953] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:45.425590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ffa45bf5-bc89-4f51-ba3a-9d3cac22f7d3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:45.436038 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ffa45bf5-bc89-4f51-ba3a-9d3cac22f7d3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1614 microversion: 2.1 time: 0.096942 Jun 08 13:56:45.436734 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 479/954] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:45 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:46.455364 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:46.456245 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:46.463034 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:46.463483 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:46.464285 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:46.464803 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:46.496801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:46.497831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:46.497831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lazy-loading 'fault' on Instance uuid 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:56:46.543368 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:46.550478 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-db6db0c7-ba4c-4bcc-9991-e84474b16b8a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 200 len: 1332 microversion: 2.1 time: 0.100267 Jun 08 13:56:46.551051 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 476/955] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:46 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:47.568003 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:47.568653 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:47.575031 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:47.575482 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:47.576271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:47.576713 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:47.591111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b HTTP/1.1 Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:56:47.592800 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:56:47.595248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '6803a856-e3c4-4bf7-b84e-7b2c36f70e4b'} Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:56:47.596408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:56:47.598570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:56:47.600288 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:56:47.600288 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4714e68f-7e0f-4736-8dff-ed52c8640fd8 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 404 len: 111 microversion: 2.1 time: 0.030800 Jun 08 13:56:47.600288 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 480/956] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:47 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:56:47.604137 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-85b412fd-f16f-40bf-9e6a-d355767562c0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '.version_select at 0x7fe2893940d0>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:47.691619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-85b412fd-f16f-40bf-9e6a-d355767562c0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809543125" status: 202 len: 0 microversion: 2.1 time: 0.091262 Jun 08 13:56:47.692237 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 477/957] 10.222.0.55 () {58 vars in 1220 bytes} [Wed Jun 8 13:56:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809543125 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:56:48.463999 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-68e21ede-e685-46e2-add2-0584252af038 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: .version_select at 0x7fe2896724c0>, body: {"keypair": {"name": "tempest-keypair-75493809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCn3VcmJUN+JoCAZUQD8EqeYy/s7TsWlGF1sgj9cRv0XA1Ke3avfCGet2ECagK3JQrHh8+FbsxYsLR2tXbLSeg1rCnUDsGVRfvoivXsqA2Bup5fr+vvdigopgx9zcwcUGw=="}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:48.478671 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-68e21ede-e685-46e2-add2-0584252af038 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:56:48.482493 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-68e21ede-e685-46e2-add2-0584252af038 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for user e50a12d7facd4e4184d79bbac03bfa74 and project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'key_pairs'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:56:48.577161 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-68e21ede-e685-46e2-add2-0584252af038 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.117077 Jun 08 13:56:48.577999 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 481/958] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 13:56:48 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:51.062159 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1300678690", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8461b72-4585-42eb-adf7-269bbd08f24f"}], "security_groups": [{"name": "tempest-securitygroup--80449279"}], "key_name": "tempest-keypair-75493809", "user_data": "}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:51.164852 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] validate_networks() for [('e8461b72-4585-42eb-adf7-269bbd08f24f', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:56:51.527812 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:56:51.528294 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:56:51.528776 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:56:51.529190 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:56:51.529609 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:56:51.539714 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:51.540233 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:51.541048 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:51.541492 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:51.558779 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:56:51.562942 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Getting quotas for user e50a12d7facd4e4184d79bbac03bfa74 and project 9015bc58fb5948a9bbc41ef874faede5. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:56:51.573922 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:56:51.576187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:56:51.743197 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-00a6771b-4953-47cd-9653-36bd43f276cb tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.685505 Jun 08 13:56:51.743980 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 478/959] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:56:51 2022] POST /compute/v2.1/servers => generated 400 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:56:51.758259 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e0f1a1ad-bb73-4616-b4f8-f1598b1e0007 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:51.759655 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e0f1a1ad-bb73-4616-b4f8-f1598b1e0007 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:51.816936 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e0f1a1ad-bb73-4616-b4f8-f1598b1e0007 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:51.823976 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e0f1a1ad-bb73-4616-b4f8-f1598b1e0007 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1240 microversion: 2.1 time: 0.070107 Jun 08 13:56:51.824583 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 482/960] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:51 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:56:52.842062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-26e5a9b9-f5e5-43e9-a6e5-a073e32a3391 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:52.842843 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-26e5a9b9-f5e5-43e9-a6e5-a073e32a3391 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:52.850318 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-26e5a9b9-f5e5-43e9-a6e5-a073e32a3391 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:52.850707 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-26e5a9b9-f5e5-43e9-a6e5-a073e32a3391 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:52.851473 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-26e5a9b9-f5e5-43e9-a6e5-a073e32a3391 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:52.851911 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-26e5a9b9-f5e5-43e9-a6e5-a073e32a3391 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:52.916872 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-26e5a9b9-f5e5-43e9-a6e5-a073e32a3391 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:52.925404 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-26e5a9b9-f5e5-43e9-a6e5-a073e32a3391 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1244 microversion: 2.1 time: 0.087946 Jun 08 13:56:52.925962 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 479/961] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:52 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:53.941978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ac586cf5-d577-4d2e-ac44-5838eecd6c76 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:53.943318 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ac586cf5-d577-4d2e-ac44-5838eecd6c76 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:53.950206 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac586cf5-d577-4d2e-ac44-5838eecd6c76 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:53.950665 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac586cf5-d577-4d2e-ac44-5838eecd6c76 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:53.951448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac586cf5-d577-4d2e-ac44-5838eecd6c76 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:53.951888 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac586cf5-d577-4d2e-ac44-5838eecd6c76 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:54.027557 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ac586cf5-d577-4d2e-ac44-5838eecd6c76 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:54.035507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ac586cf5-d577-4d2e-ac44-5838eecd6c76 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1310 microversion: 2.1 time: 0.098097 Jun 08 13:56:54.036532 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 483/962] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:53 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:55.053040 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-86f70420-0a48-4653-a1b2-8bb38617540b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:55.053900 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-86f70420-0a48-4653-a1b2-8bb38617540b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:55.060529 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-86f70420-0a48-4653-a1b2-8bb38617540b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:55.060989 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-86f70420-0a48-4653-a1b2-8bb38617540b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:55.061773 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-86f70420-0a48-4653-a1b2-8bb38617540b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:55.062225 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-86f70420-0a48-4653-a1b2-8bb38617540b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:55.194263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-86f70420-0a48-4653-a1b2-8bb38617540b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:55.202469 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-86f70420-0a48-4653-a1b2-8bb38617540b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1364 microversion: 2.1 time: 0.153544 Jun 08 13:56:55.203055 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 480/963] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:55 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:55.514008 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-106e15c3-a208-468e-a28e-28b6dc8964e4 req-2af65ea5-d84c-49bc-b0d7-83960c76612f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b58c19e1-082e-4f9f-9cdf-64aa35966e00", "tag": "ce2ba699-06c6-4731-b1e0-bc5cdaae29bb"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:55.526073 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-106e15c3-a208-468e-a28e-28b6dc8964e4 req-2af65ea5-d84c-49bc-b0d7-83960c76612f service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:55.526721 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-106e15c3-a208-468e-a28e-28b6dc8964e4 req-2af65ea5-d84c-49bc-b0d7-83960c76612f service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:55.540078 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-106e15c3-a208-468e-a28e-28b6dc8964e4 req-2af65ea5-d84c-49bc-b0d7-83960c76612f service nova] Creating event network-changed:ce2ba699-06c6-4731-b1e0-bc5cdaae29bb for instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 on hv-cinder-81914 Jun 08 13:56:55.545882 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-106e15c3-a208-468e-a28e-28b6dc8964e4 req-2af65ea5-d84c-49bc-b0d7-83960c76612f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035604 Jun 08 13:56:55.547342 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 484/964] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:56.221852 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2726f708-2019-4d3a-8622-13c43e944d09 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:56.222747 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2726f708-2019-4d3a-8622-13c43e944d09 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:56.229418 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2726f708-2019-4d3a-8622-13c43e944d09 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:56.229882 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2726f708-2019-4d3a-8622-13c43e944d09 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:56.230667 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2726f708-2019-4d3a-8622-13c43e944d09 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:56.231110 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2726f708-2019-4d3a-8622-13c43e944d09 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:56.365603 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2726f708-2019-4d3a-8622-13c43e944d09 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:56.373054 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2726f708-2019-4d3a-8622-13c43e944d09 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1364 microversion: 2.1 time: 0.156080 Jun 08 13:56:56.373632 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 481/965] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:56 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:57.391006 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-40ad960c-63ca-4ae0-a36a-ba299067a50a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:57.391741 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-40ad960c-63ca-4ae0-a36a-ba299067a50a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:57.399222 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-40ad960c-63ca-4ae0-a36a-ba299067a50a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:57.399677 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-40ad960c-63ca-4ae0-a36a-ba299067a50a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:57.400475 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-40ad960c-63ca-4ae0-a36a-ba299067a50a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:57.400913 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-40ad960c-63ca-4ae0-a36a-ba299067a50a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:57.529133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-40ad960c-63ca-4ae0-a36a-ba299067a50a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:57.537721 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-40ad960c-63ca-4ae0-a36a-ba299067a50a tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1364 microversion: 2.1 time: 0.150949 Jun 08 13:56:57.538295 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 485/966] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:57 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:58.555023 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e535d1d5-78d3-445b-bc9c-d1ae676d84ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:58.555638 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e535d1d5-78d3-445b-bc9c-d1ae676d84ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:58.562182 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e535d1d5-78d3-445b-bc9c-d1ae676d84ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:58.562631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e535d1d5-78d3-445b-bc9c-d1ae676d84ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:58.563398 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e535d1d5-78d3-445b-bc9c-d1ae676d84ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:58.563836 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e535d1d5-78d3-445b-bc9c-d1ae676d84ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:58.698903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e535d1d5-78d3-445b-bc9c-d1ae676d84ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:58.706496 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e535d1d5-78d3-445b-bc9c-d1ae676d84ad tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1364 microversion: 2.1 time: 0.155833 Jun 08 13:56:58.708124 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 482/967] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:58 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:56:59.612580 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-ccee0276-b927-4c02-a86e-b86e8fc88e54 req-eb84a9e7-7599-48f7-87c9-86fb40cb1790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58c19e1-082e-4f9f-9cdf-64aa35966e00", "name": "network-vif-plugged", "status": "completed", "tag": "ce2ba699-06c6-4731-b1e0-bc5cdaae29bb"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:56:59.622030 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-ccee0276-b927-4c02-a86e-b86e8fc88e54 req-eb84a9e7-7599-48f7-87c9-86fb40cb1790 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:59.622484 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-ccee0276-b927-4c02-a86e-b86e8fc88e54 req-eb84a9e7-7599-48f7-87c9-86fb40cb1790 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:59.636246 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-ccee0276-b927-4c02-a86e-b86e8fc88e54 req-eb84a9e7-7599-48f7-87c9-86fb40cb1790 service nova] Creating event network-vif-plugged:ce2ba699-06c6-4731-b1e0-bc5cdaae29bb for instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 on hv-cinder-81914 Jun 08 13:56:59.641155 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-ccee0276-b927-4c02-a86e-b86e8fc88e54 req-eb84a9e7-7599-48f7-87c9-86fb40cb1790 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032339 Jun 08 13:56:59.641722 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 486/968] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:56:59.724862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-256865a6-2d85-453b-a4ff-cf4592811d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:56:59.725490 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-256865a6-2d85-453b-a4ff-cf4592811d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:56:59.732305 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-256865a6-2d85-453b-a4ff-cf4592811d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:59.735325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-256865a6-2d85-453b-a4ff-cf4592811d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:59.735325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-256865a6-2d85-453b-a4ff-cf4592811d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:56:59.735325 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-256865a6-2d85-453b-a4ff-cf4592811d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:56:59.865909 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-256865a6-2d85-453b-a4ff-cf4592811d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:56:59.873348 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-256865a6-2d85-453b-a4ff-cf4592811d17 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1364 microversion: 2.1 time: 0.152858 Jun 08 13:56:59.873909 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 483/969] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:56:59 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:57:00.891545 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bc32ad05-5081-4d76-812c-c45317282b7e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:00.892305 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bc32ad05-5081-4d76-812c-c45317282b7e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:00.899811 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bc32ad05-5081-4d76-812c-c45317282b7e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:00.902736 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bc32ad05-5081-4d76-812c-c45317282b7e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:00.902736 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bc32ad05-5081-4d76-812c-c45317282b7e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:00.902736 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bc32ad05-5081-4d76-812c-c45317282b7e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:01.033034 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bc32ad05-5081-4d76-812c-c45317282b7e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:57:01.041362 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bc32ad05-5081-4d76-812c-c45317282b7e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1364 microversion: 2.1 time: 0.154483 Jun 08 13:57:01.041935 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 487/970] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:00 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:57:02.058739 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-97a54213-7e62-4407-9469-ddbb605f44f3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:02.059395 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-97a54213-7e62-4407-9469-ddbb605f44f3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:02.061839 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:57:02.062511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=6 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:57:02.067366 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97a54213-7e62-4407-9469-ddbb605f44f3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:02.067819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97a54213-7e62-4407-9469-ddbb605f44f3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:02.068791 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97a54213-7e62-4407-9469-ddbb605f44f3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:02.069233 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-97a54213-7e62-4407-9469-ddbb605f44f3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:02.201394 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-97a54213-7e62-4407-9469-ddbb605f44f3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:57:02.208763 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-97a54213-7e62-4407-9469-ddbb605f44f3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1554 microversion: 2.1 time: 0.154009 Jun 08 13:57:02.210035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 484/971] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:02 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:57:02.226495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f556b7f6-e378-44db-99d9-04e784a94824 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:02.226991 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f556b7f6-e378-44db-99d9-04e784a94824 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:02.228960 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=6 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:57:02.234250 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f556b7f6-e378-44db-99d9-04e784a94824 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:02.239624 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f556b7f6-e378-44db-99d9-04e784a94824 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:02.239624 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f556b7f6-e378-44db-99d9-04e784a94824 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:02.239624 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f556b7f6-e378-44db-99d9-04e784a94824 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:02.312632 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f556b7f6-e378-44db-99d9-04e784a94824 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090561 Jun 08 13:57:02.313371 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 488/972] 10.222.0.55 () {58 vars in 1274 bytes} [Wed Jun 8 13:57:02 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:57:03.528391 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-beb604ea-4905-4044-beba-1981b2f3fea4 req-bf00784a-4056-46ff-b3ac-5a58fbfb63c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b58c19e1-082e-4f9f-9cdf-64aa35966e00", "tag": "ce2ba699-06c6-4731-b1e0-bc5cdaae29bb"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:57:03.537924 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-beb604ea-4905-4044-beba-1981b2f3fea4 req-bf00784a-4056-46ff-b3ac-5a58fbfb63c7 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:03.538372 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-beb604ea-4905-4044-beba-1981b2f3fea4 req-bf00784a-4056-46ff-b3ac-5a58fbfb63c7 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:03.549474 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-beb604ea-4905-4044-beba-1981b2f3fea4 req-bf00784a-4056-46ff-b3ac-5a58fbfb63c7 service nova] Creating event network-changed:ce2ba699-06c6-4731-b1e0-bc5cdaae29bb for instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 on hv-cinder-81914 Jun 08 13:57:03.555891 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-beb604ea-4905-4044-beba-1981b2f3fea4 req-bf00784a-4056-46ff-b3ac-5a58fbfb63c7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031231 Jun 08 13:57:03.556553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 485/973] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:57:37.819426 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:57:37.820236 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:57:37.824408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3b5b0fef-e251-4f7e-8bc0-3e7cf859c3de tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:37.824905 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3b5b0fef-e251-4f7e-8bc0-3e7cf859c3de tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:37.830802 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3b5b0fef-e251-4f7e-8bc0-3e7cf859c3de tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:37.834744 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3b5b0fef-e251-4f7e-8bc0-3e7cf859c3de tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:37.834744 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3b5b0fef-e251-4f7e-8bc0-3e7cf859c3de tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:37.834744 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3b5b0fef-e251-4f7e-8bc0-3e7cf859c3de tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:37.855701 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3b5b0fef-e251-4f7e-8bc0-3e7cf859c3de tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/ips" status: 200 len: 149 microversion: 2.1 time: 0.037696 Jun 08 13:57:37.856295 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 489/974] 10.222.0.55 () {58 vars in 1247 bytes} [Wed Jun 8 13:57:37 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:57:39.500765 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:57:39.501518 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:57:39.505771 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-eeff35d3-9e49-454d-9b0c-9b00894cde15 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "831c7a00-5e58-4f99-aec4-343c4b1f7fc0"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:57:39.506909 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-eeff35d3-9e49-454d-9b0c-9b00894cde15 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:39.512929 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eeff35d3-9e49-454d-9b0c-9b00894cde15 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:39.514226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eeff35d3-9e49-454d-9b0c-9b00894cde15 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:39.514226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eeff35d3-9e49-454d-9b0c-9b00894cde15 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:39.514556 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-eeff35d3-9e49-454d-9b0c-9b00894cde15 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:40.345248 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-eeff35d3-9e49-454d-9b0c-9b00894cde15 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "POST /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845685 Jun 08 13:57:40.345991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 486/975] 10.222.0.55 () {60 vars in 1322 bytes} [Wed Jun 8 13:57:39 2022] POST /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:57:47.922626 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4e08df61-4bc0-49fc-9e2f-401884a4278b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:47.923107 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4e08df61-4bc0-49fc-9e2f-401884a4278b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:47.931291 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4e08df61-4bc0-49fc-9e2f-401884a4278b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:47.931748 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4e08df61-4bc0-49fc-9e2f-401884a4278b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:47.932560 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4e08df61-4bc0-49fc-9e2f-401884a4278b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:47.933031 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4e08df61-4bc0-49fc-9e2f-401884a4278b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:48.014805 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.objects.instance [None req-4e08df61-4bc0-49fc-9e2f-401884a4278b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lazy-loading 'services' on Instance uuid b58c19e1-082e-4f9f-9cdf-64aa35966e00 {{(pid=124628) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:57:48.227577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4e08df61-4bc0-49fc-9e2f-401884a4278b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments/831c7a00-5e58-4f99-aec4-343c4b1f7fc0" status: 202 len: 0 microversion: 2.1 time: 0.310164 Jun 08 13:57:48.228176 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 490/976] 10.222.0.55 () {58 vars in 1415 bytes} [Wed Jun 8 13:57:47 2022] DELETE /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments/831c7a00-5e58-4f99-aec4-343c4b1f7fc0 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:57:48.237600 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-07cf753d-1b04-45c4-8ca3-f1ceea81c255 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:48.238722 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-07cf753d-1b04-45c4-8ca3-f1ceea81c255 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:48.245040 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-07cf753d-1b04-45c4-8ca3-f1ceea81c255 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:48.245442 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-07cf753d-1b04-45c4-8ca3-f1ceea81c255 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:48.246218 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-07cf753d-1b04-45c4-8ca3-f1ceea81c255 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:48.246696 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-07cf753d-1b04-45c4-8ca3-f1ceea81c255 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:48.276768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-07cf753d-1b04-45c4-8ca3-f1ceea81c255 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Jun 08 13:57:48.277680 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 487/977] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:57:48 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 13:57:49.290379 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9c1e9069-f494-4cfd-a262-0b5cc0933810 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:49.291448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-9c1e9069-f494-4cfd-a262-0b5cc0933810 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:49.297682 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9c1e9069-f494-4cfd-a262-0b5cc0933810 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:49.298136 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9c1e9069-f494-4cfd-a262-0b5cc0933810 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:49.298895 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9c1e9069-f494-4cfd-a262-0b5cc0933810 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:49.299332 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9c1e9069-f494-4cfd-a262-0b5cc0933810 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:49.328540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9c1e9069-f494-4cfd-a262-0b5cc0933810 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043408 Jun 08 13:57:49.329013 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 491/978] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:57:49 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:57:50.340730 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f8210e04-e012-4130-9d40-6a2d835957e3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:50.344072 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f8210e04-e012-4130-9d40-6a2d835957e3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:50.348525 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8210e04-e012-4130-9d40-6a2d835957e3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:50.348970 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8210e04-e012-4130-9d40-6a2d835957e3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:50.349734 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8210e04-e012-4130-9d40-6a2d835957e3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:50.350163 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f8210e04-e012-4130-9d40-6a2d835957e3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:50.379550 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f8210e04-e012-4130-9d40-6a2d835957e3 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042886 Jun 08 13:57:50.380114 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 488/979] 10.222.0.55 () {58 vars in 1301 bytes} [Wed Jun 8 13:57:50 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 08 13:57:50.438589 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c18e361b-afb5-4147-94e4-e3b059ad5628 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:50.439129 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c18e361b-afb5-4147-94e4-e3b059ad5628 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:50.446138 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c18e361b-afb5-4147-94e4-e3b059ad5628 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:50.446595 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c18e361b-afb5-4147-94e4-e3b059ad5628 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:50.447360 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c18e361b-afb5-4147-94e4-e3b059ad5628 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:50.447794 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c18e361b-afb5-4147-94e4-e3b059ad5628 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:50.472068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c18e361b-afb5-4147-94e4-e3b059ad5628 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Going to try to terminate instance {{(pid=124628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:57:50.815892 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c18e361b-afb5-4147-94e4-e3b059ad5628 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 204 len: 0 microversion: 2.1 time: 0.380792 Jun 08 13:57:50.816515 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 492/980] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:57:50 2022] DELETE /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:57:50.824719 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-56cd45f1-1b97-4735-8ee4-da979746a501 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:50.825359 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-56cd45f1-1b97-4735-8ee4-da979746a501 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:50.831292 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-56cd45f1-1b97-4735-8ee4-da979746a501 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:50.831738 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-56cd45f1-1b97-4735-8ee4-da979746a501 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:50.832533 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-56cd45f1-1b97-4735-8ee4-da979746a501 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:50.832967 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-56cd45f1-1b97-4735-8ee4-da979746a501 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:50.965078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-56cd45f1-1b97-4735-8ee4-da979746a501 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:57:50.972764 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-56cd45f1-1b97-4735-8ee4-da979746a501 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1678 microversion: 2.1 time: 0.151646 Jun 08 13:57:50.973340 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 489/981] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:50 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:57:51.992873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-41ddc9f1-7a2e-4995-9a29-4ab311165c7d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:51.993621 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-41ddc9f1-7a2e-4995-9a29-4ab311165c7d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:52.000296 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-41ddc9f1-7a2e-4995-9a29-4ab311165c7d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:52.000760 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-41ddc9f1-7a2e-4995-9a29-4ab311165c7d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:52.001567 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-41ddc9f1-7a2e-4995-9a29-4ab311165c7d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:52.002011 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-41ddc9f1-7a2e-4995-9a29-4ab311165c7d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:52.135216 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-41ddc9f1-7a2e-4995-9a29-4ab311165c7d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:57:52.142661 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-41ddc9f1-7a2e-4995-9a29-4ab311165c7d tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1678 microversion: 2.1 time: 0.155830 Jun 08 13:57:52.143228 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 493/982] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:51 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:57:53.159735 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-9e12b529-73e8-41c7-8f78-39aedd847fcc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:53.160807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-9e12b529-73e8-41c7-8f78-39aedd847fcc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:53.167969 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e12b529-73e8-41c7-8f78-39aedd847fcc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:53.168382 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e12b529-73e8-41c7-8f78-39aedd847fcc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:53.169155 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e12b529-73e8-41c7-8f78-39aedd847fcc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:53.169590 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-9e12b529-73e8-41c7-8f78-39aedd847fcc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:53.244822 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-9e12b529-73e8-41c7-8f78-39aedd847fcc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e50a12d7facd4e4184d79bbac03bfa74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9015bc58fb5948a9bbc41ef874faede5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:57:53.259426 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-9e12b529-73e8-41c7-8f78-39aedd847fcc tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 200 len: 1612 microversion: 2.1 time: 0.096841 Jun 08 13:57:53.263111 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 490/983] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:53 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 1612 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:57:53.269899 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-92a786dc-83f5-4c37-8f3c-429ea9d97447 req-01394eea-f57d-42ce-a112-a58e86985fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58c19e1-082e-4f9f-9cdf-64aa35966e00", "name": "network-vif-deleted", "tag": "ce2ba699-06c6-4731-b1e0-bc5cdaae29bb"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:57:53.278191 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-92a786dc-83f5-4c37-8f3c-429ea9d97447 req-01394eea-f57d-42ce-a112-a58e86985fee service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:53.278629 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-92a786dc-83f5-4c37-8f3c-429ea9d97447 req-01394eea-f57d-42ce-a112-a58e86985fee service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:53.294178 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-92a786dc-83f5-4c37-8f3c-429ea9d97447 req-01394eea-f57d-42ce-a112-a58e86985fee service nova] Creating event network-vif-deleted:ce2ba699-06c6-4731-b1e0-bc5cdaae29bb for instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 on hv-cinder-81914 Jun 08 13:57:53.299154 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-92a786dc-83f5-4c37-8f3c-429ea9d97447 req-01394eea-f57d-42ce-a112-a58e86985fee service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122788 Jun 08 13:57:53.305408 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 494/984] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:57:54.270428 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:54.273205 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:54.278012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:54.278458 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:54.279280 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:54.279718 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:54.295193 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 HTTP/1.1 Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:57:54.296869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:54.298807 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'b58c19e1-082e-4f9f-9cdf-64aa35966e00'} Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:57:54.299750 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:54.301415 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:54.302786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:57:54.302786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-6e3eaa51-003b-468f-a53d-880f0554f705 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 404 len: 111 microversion: 2.1 time: 0.031702 Jun 08 13:57:54.302786 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 491/985] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:54 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:57:54.308980 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9489e77e-a376-41e2-9ff7-ef2677c7bbc5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '.version_select at 0x7fe289724a60>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:54.440112 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9489e77e-a376-41e2-9ff7-ef2677c7bbc5 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-75493809" status: 202 len: 0 microversion: 2.1 time: 0.136401 Jun 08 13:57:54.440717 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 495/986] 10.222.0.55 () {58 vars in 1214 bytes} [Wed Jun 8 13:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-75493809 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 13:57:56.594855 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:56.595349 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:56.602857 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:56.603298 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:56.604090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:56.604511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:56.618336 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: DELETE /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 HTTP/1.1 Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:57:56.619878 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.621307 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'b58c19e1-082e-4f9f-9cdf-64aa35966e00'} Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:57:56.622079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.623599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.625441 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:57:56.625441 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7dbc4a9a-492f-429c-ba83-76e48ac2652b tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 404 len: 111 microversion: 2.1 time: 0.030252 Jun 08 13:57:56.625441 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 492/987] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:57:56 2022] DELETE /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:57:56.630226 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:56.630967 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: b58c19e1-082e-4f9f-9cdf-64aa35966e00] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:56.638054 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:56.638510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:56.639281 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:56.639762 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:56.653019 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 HTTP/1.1 Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:57:56.654639 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.656407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'b58c19e1-082e-4f9f-9cdf-64aa35966e00'} Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:57:56.657419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. Jun 08 13:57:56.659043 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:56.660492 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance b58c19e1-082e-4f9f-9cdf-64aa35966e00 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:57:56.660492 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-427fee9f-1a71-4bb4-9f59-1a2b7377ee88 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00" status: 404 len: 111 microversion: 2.1 time: 0.030136 Jun 08 13:57:56.660492 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 496/988] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:56 2022] GET /compute/v2.1/servers/b58c19e1-082e-4f9f-9cdf-64aa35966e00 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:57:58.023173 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:58.023673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:58.030693 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:58.031136 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:58.031889 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:58.032339 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:58.045358 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: DELETE /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b HTTP/1.1 Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:57:58.046904 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.048635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '6803a856-e3c4-4bf7-b84e-7b2c36f70e4b'} Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:57:58.049555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.050797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.052493 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:57:58.052493 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-98d589fa-2579-4ad0-af0e-5606478030af tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 404 len: 111 microversion: 2.1 time: 0.028961 Jun 08 13:57:58.052493 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 493/989] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:57:58 2022] DELETE /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:57:58.056697 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:58.057365 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:58.063958 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:58.064441 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:58.065247 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:58.065688 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:58.079274 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b HTTP/1.1 Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:57:58.080849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.082509 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '6803a856-e3c4-4bf7-b84e-7b2c36f70e4b'} Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:57:58.083440 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. Jun 08 13:57:58.085066 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.086424 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance 6803a856-e3c4-4bf7-b84e-7b2c36f70e4b could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:57:58.086424 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2a3b07a6-134b-4ff2-9ffa-c2962f68a263 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b" status: 404 len: 111 microversion: 2.1 time: 0.029473 Jun 08 13:57:58.086424 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 497/990] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:58 2022] GET /compute/v2.1/servers/6803a856-e3c4-4bf7-b84e-7b2c36f70e4b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 13:57:58.092987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:58.093580 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:58.100357 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:58.100815 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:58.101633 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:58.102079 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:58.115880 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: DELETE /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c HTTP/1.1 Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:57:58.117467 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.119099 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '5e5f2091-a20c-4030-8483-8ecc25d4cf9c'} Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:57:58.120291 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.121631 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.123164 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:57:58.123164 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f03fedad-0834-4a70-a07e-aee0addc230e tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 404 len: 111 microversion: 2.1 time: 0.031606 Jun 08 13:57:58.123164 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 494/991] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:57:58 2022] DELETE /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 13:57:58.127731 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:58.128380 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: 5e5f2091-a20c-4030-8483-8ecc25d4cf9c] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:58.134467 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:58.134922 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:58.135694 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:58.136666 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:58.150209 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c HTTP/1.1 Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:57:58.151745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.154098 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '5e5f2091-a20c-4030-8483-8ecc25d4cf9c'} Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:57:58.155111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. Jun 08 13:57:58.156847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:58.158275 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance 5e5f2091-a20c-4030-8483-8ecc25d4cf9c could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:57:58.158275 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-903074c2-5efd-4f3c-a025-8d6c1e646de7 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c" status: 404 len: 111 microversion: 2.1 time: 0.030212 Jun 08 13:57:58.158275 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 498/992] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:58 2022] GET /compute/v2.1/servers/5e5f2091-a20c-4030-8483-8ecc25d4cf9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:57:59.502042 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:59.502528 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:59.509005 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:59.509454 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:59.510224 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:59.510662 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:59.524689 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: DELETE /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 HTTP/1.1 Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 13:57:59.526215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.528407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': 'ec5f074e-36e2-487e-9c9f-b613edaa6bf0'} Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:57:59.529187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.530742 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.532361 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:57:59.532361 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-91e5663b-52ea-4499-ad97-bdbd726b1dc0 tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 404 len: 111 microversion: 2.1 time: 0.030128 Jun 08 13:57:59.532361 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 495/993] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:57:59 2022] DELETE /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 13:57:59.536677 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:57:59.537326 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] [instance: ec5f074e-36e2-487e-9c9f-b613edaa6bf0] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:57:59.543819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:59.544308 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:59.545071 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:57:59.545513 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:57:59.558592 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] HTTP exception thrown: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Request method failure captured: Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 HTTP/1.1 Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKnY_qpFdfKpTSQShyRmpNlgKjVm07vaiukO1xzEtIZuTqkebmfGFVC9RVLJWbX1DF9vRUop1_DIisYNEc3g5oXUWAtlX2CliH5WdLFedrwQAggBEl3a-8hezDd-kcd2JdyzLSYhMkp4WsPRtV5i7Xxd77ZlSb63Tp98FIZ45I7EBaE Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:57:59.560334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9015bc58fb5948a9bbc41ef874faede5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9015bc58fb5948a9bbc41ef874faede5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9015bc58fb5948a9bbc41ef874faede5"}]}] Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 9015bc58fb5948a9bbc41ef874faede5 Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1545500499 Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: e50a12d7facd4e4184d79bbac03bfa74 Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-AttachVolumeNegativeTest-1545500499-project Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.562104 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': 'ec5f074e-36e2-487e-9c9f-b613edaa6bf0'} Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:57:59.563215 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. Jun 08 13:57:59.564763 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:57:59.566181 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] Returning 404 to user: Instance ec5f074e-36e2-487e-9c9f-b613edaa6bf0 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:57:59.566181 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8e99dbc5-1c04-4211-b5c3-1329c658306c tempest-AttachVolumeNegativeTest-1545500499 tempest-AttachVolumeNegativeTest-1545500499-project] 10.222.0.55 "GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0" status: 404 len: 111 microversion: 2.1 time: 0.028603 Jun 08 13:57:59.566181 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 499/994] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:57:59 2022] GET /compute/v2.1/servers/ec5f074e-36e2-487e-9c9f-b613edaa6bf0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 13:59:14.084214 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=20 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:14.085012 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:14.089061 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1658711488", "imageRef": "93e121a5-f20b-48cd-9a36-36ad631676c7", "flavorRef": "452"}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:59:14.142107 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] validate_networks() for None {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 13:59:14.421209 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 13:59:14.421633 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 13:59:14.422106 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 13:59:14.422511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 13:59:14.422919 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 13:59:14.432720 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:14.433165 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:14.433958 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:14.434390 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:14.451365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Getting quotas for project b2ba93f28ab34253903b52621b23cb19. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 13:59:14.456968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Getting quotas for user b6832ef66d864584943fd1435c3dcc27 and project b2ba93f28ab34253903b52621b23cb19. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 13:59:14.466290 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 13:59:14.468578 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='93e121a5-f20b-48cd-9a36-36ad631676c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 13:59:14.635304 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c7f56878-9e3b-4101-9db8-03a51692366a tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552493 Jun 08 13:59:14.636146 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 496/995] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 13:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 13:59:14.645220 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:14.646229 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:14.651016 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-16560544-c396-462b-86b4-893df1d5eea5 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:14.651640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-16560544-c396-462b-86b4-893df1d5eea5 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:14.706607 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-16560544-c396-462b-86b4-893df1d5eea5 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:14.714186 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-16560544-c396-462b-86b4-893df1d5eea5 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1215 microversion: 2.1 time: 0.071677 Jun 08 13:59:14.714764 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 500/996] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:14 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:15.732380 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5da807ce-20bc-4256-ad98-016f5d0b7ac9 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:15.733058 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5da807ce-20bc-4256-ad98-016f5d0b7ac9 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:15.784965 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5da807ce-20bc-4256-ad98-016f5d0b7ac9 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:15.792288 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5da807ce-20bc-4256-ad98-016f5d0b7ac9 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1215 microversion: 2.1 time: 0.064889 Jun 08 13:59:15.792901 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 497/997] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:15 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:16.809180 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ac0a7111-787c-465e-871b-9fda12c8c122 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:16.809819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ac0a7111-787c-465e-871b-9fda12c8c122 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:16.819143 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac0a7111-787c-465e-871b-9fda12c8c122 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:16.821135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac0a7111-787c-465e-871b-9fda12c8c122 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:16.821135 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac0a7111-787c-465e-871b-9fda12c8c122 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:16.821470 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-ac0a7111-787c-465e-871b-9fda12c8c122 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:16.885682 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ac0a7111-787c-465e-871b-9fda12c8c122 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:16.893196 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ac0a7111-787c-465e-871b-9fda12c8c122 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1267 microversion: 2.1 time: 0.088008 Jun 08 13:59:16.893761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 501/998] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:16 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:17.910989 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2102d182-595b-4bd6-994d-26f75f11b7c7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:17.911601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2102d182-595b-4bd6-994d-26f75f11b7c7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:17.919108 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2102d182-595b-4bd6-994d-26f75f11b7c7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:17.919549 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2102d182-595b-4bd6-994d-26f75f11b7c7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:17.920354 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2102d182-595b-4bd6-994d-26f75f11b7c7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:17.920791 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2102d182-595b-4bd6-994d-26f75f11b7c7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:17.985488 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2102d182-595b-4bd6-994d-26f75f11b7c7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:17.993367 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2102d182-595b-4bd6-994d-26f75f11b7c7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1273 microversion: 2.1 time: 0.086295 Jun 08 13:59:17.993944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 498/999] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:17 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:19.010271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f2bbc781-d6d5-422e-b693-075bf9f5f58c tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:19.010893 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f2bbc781-d6d5-422e-b693-075bf9f5f58c tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:19.019733 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f2bbc781-d6d5-422e-b693-075bf9f5f58c tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:19.020213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f2bbc781-d6d5-422e-b693-075bf9f5f58c tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:19.021111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f2bbc781-d6d5-422e-b693-075bf9f5f58c tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:19.021545 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f2bbc781-d6d5-422e-b693-075bf9f5f58c tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:19.165477 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f2bbc781-d6d5-422e-b693-075bf9f5f58c tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:19.173621 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f2bbc781-d6d5-422e-b693-075bf9f5f58c tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1315 microversion: 2.1 time: 0.167478 Jun 08 13:59:19.174201 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 502/1000] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:19 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:19.290895 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-5d56043e-85f7-4608-84a9-e16bb77a71aa req-a7433c6c-cfa1-4e49-81a6-f8aa934156bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d34e1f6-a2df-4f99-a8dd-66703601a6f7", "tag": "310910f4-9dad-420d-a82d-e04427479dd5"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:59:19.301254 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-5d56043e-85f7-4608-84a9-e16bb77a71aa req-a7433c6c-cfa1-4e49-81a6-f8aa934156bd service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:19.301792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-5d56043e-85f7-4608-84a9-e16bb77a71aa req-a7433c6c-cfa1-4e49-81a6-f8aa934156bd service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:19.320828 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-5d56043e-85f7-4608-84a9-e16bb77a71aa req-a7433c6c-cfa1-4e49-81a6-f8aa934156bd service nova] Creating event network-changed:310910f4-9dad-420d-a82d-e04427479dd5 for instance 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 on hv-cinder-81914 Jun 08 13:59:19.326588 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-5d56043e-85f7-4608-84a9-e16bb77a71aa req-a7433c6c-cfa1-4e49-81a6-f8aa934156bd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039663 Jun 08 13:59:19.327406 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 499/1001] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:59:20.190886 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-4c15a24c-92a0-4cea-93c7-132ceead1fc1 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:20.191510 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-4c15a24c-92a0-4cea-93c7-132ceead1fc1 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:20.199165 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4c15a24c-92a0-4cea-93c7-132ceead1fc1 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:20.199564 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4c15a24c-92a0-4cea-93c7-132ceead1fc1 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:20.200372 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4c15a24c-92a0-4cea-93c7-132ceead1fc1 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:20.200817 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-4c15a24c-92a0-4cea-93c7-132ceead1fc1 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:20.329128 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-4c15a24c-92a0-4cea-93c7-132ceead1fc1 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:20.336386 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-4c15a24c-92a0-4cea-93c7-132ceead1fc1 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1315 microversion: 2.1 time: 0.149434 Jun 08 13:59:20.336940 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 503/1002] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:20 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:21.354609 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-89a85f9d-d922-4d7e-885a-704320ba62a4 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:21.355236 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-89a85f9d-d922-4d7e-885a-704320ba62a4 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:21.361516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-89a85f9d-d922-4d7e-885a-704320ba62a4 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:21.361964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-89a85f9d-d922-4d7e-885a-704320ba62a4 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:21.362723 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-89a85f9d-d922-4d7e-885a-704320ba62a4 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:21.363166 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-89a85f9d-d922-4d7e-885a-704320ba62a4 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:21.490635 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-89a85f9d-d922-4d7e-885a-704320ba62a4 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:21.498051 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-89a85f9d-d922-4d7e-885a-704320ba62a4 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1315 microversion: 2.1 time: 0.148565 Jun 08 13:59:21.498618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 500/1003] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:21 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 13:59:22.514847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3c3574a1-8d8d-42c8-bf8f-a79765cdb718 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:22.515586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3c3574a1-8d8d-42c8-bf8f-a79765cdb718 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:22.522070 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c3574a1-8d8d-42c8-bf8f-a79765cdb718 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:22.522461 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c3574a1-8d8d-42c8-bf8f-a79765cdb718 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:22.523234 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c3574a1-8d8d-42c8-bf8f-a79765cdb718 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:22.523677 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3c3574a1-8d8d-42c8-bf8f-a79765cdb718 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:22.654563 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3c3574a1-8d8d-42c8-bf8f-a79765cdb718 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:22.661977 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3c3574a1-8d8d-42c8-bf8f-a79765cdb718 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1315 microversion: 2.1 time: 0.151114 Jun 08 13:59:22.662547 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 504/1004] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:22 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:23.679536 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2c1444e6-52ef-4f57-9366-2a2a29d77390 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:23.680158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2c1444e6-52ef-4f57-9366-2a2a29d77390 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:23.687355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2c1444e6-52ef-4f57-9366-2a2a29d77390 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:23.687804 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2c1444e6-52ef-4f57-9366-2a2a29d77390 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:23.688630 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2c1444e6-52ef-4f57-9366-2a2a29d77390 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:23.689071 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2c1444e6-52ef-4f57-9366-2a2a29d77390 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:23.814459 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2c1444e6-52ef-4f57-9366-2a2a29d77390 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:23.821883 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2c1444e6-52ef-4f57-9366-2a2a29d77390 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1315 microversion: 2.1 time: 0.146344 Jun 08 13:59:23.822681 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 501/1005] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:23 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:24.361094 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-016341f8-f606-4032-8207-7d861586da2d req-baf34ae1-233c-4b89-a5fe-124eb6a12b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d34e1f6-a2df-4f99-a8dd-66703601a6f7", "name": "network-vif-plugged", "status": "completed", "tag": "310910f4-9dad-420d-a82d-e04427479dd5"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:59:24.369391 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-016341f8-f606-4032-8207-7d861586da2d req-baf34ae1-233c-4b89-a5fe-124eb6a12b2b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:24.369849 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-016341f8-f606-4032-8207-7d861586da2d req-baf34ae1-233c-4b89-a5fe-124eb6a12b2b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:24.381234 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-016341f8-f606-4032-8207-7d861586da2d req-baf34ae1-233c-4b89-a5fe-124eb6a12b2b service nova] Creating event network-vif-plugged:310910f4-9dad-420d-a82d-e04427479dd5 for instance 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 on hv-cinder-81914 Jun 08 13:59:24.387031 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-016341f8-f606-4032-8207-7d861586da2d req-baf34ae1-233c-4b89-a5fe-124eb6a12b2b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157123 Jun 08 13:59:24.387630 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 505/1006] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:59:24.838997 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bf94c9c2-64ec-4e0d-9672-8267e5d09980 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:24.839618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bf94c9c2-64ec-4e0d-9672-8267e5d09980 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:24.841619 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:24.847035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf94c9c2-64ec-4e0d-9672-8267e5d09980 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:24.847489 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf94c9c2-64ec-4e0d-9672-8267e5d09980 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:24.848295 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf94c9c2-64ec-4e0d-9672-8267e5d09980 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:24.848741 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bf94c9c2-64ec-4e0d-9672-8267e5d09980 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:24.979794 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bf94c9c2-64ec-4e0d-9672-8267e5d09980 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:24.987282 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bf94c9c2-64ec-4e0d-9672-8267e5d09980 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1315 microversion: 2.1 time: 0.152417 Jun 08 13:59:24.987797 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 502/1007] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:24 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:26.002075 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:26.007498 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-082ca04f-0c4b-433a-ba2e-1cf212696970 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:26.008226 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-082ca04f-0c4b-433a-ba2e-1cf212696970 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:26.016387 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-082ca04f-0c4b-433a-ba2e-1cf212696970 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:26.016845 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-082ca04f-0c4b-433a-ba2e-1cf212696970 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:26.017617 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-082ca04f-0c4b-433a-ba2e-1cf212696970 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:26.018050 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-082ca04f-0c4b-433a-ba2e-1cf212696970 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:26.120883 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 13:59:26.121524 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Wed Jun 8 13:59:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 13:59:26.374525 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-082ca04f-0c4b-433a-ba2e-1cf212696970 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:26.382028 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-082ca04f-0c4b-433a-ba2e-1cf212696970 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1465 microversion: 2.1 time: 0.380925 Jun 08 13:59:26.382588 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 506/1008] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:25 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1465 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:26.426490 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-ec54b171-73b2-4c29-948b-0e8ad61306b7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:26.426989 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ec54b171-73b2-4c29-948b-0e8ad61306b7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:26.428881 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=8 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 13:59:26.435105 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ec54b171-73b2-4c29-948b-0e8ad61306b7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:26.435550 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ec54b171-73b2-4c29-948b-0e8ad61306b7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:26.436332 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ec54b171-73b2-4c29-948b-0e8ad61306b7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:26.436765 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-ec54b171-73b2-4c29-948b-0e8ad61306b7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:26.461186 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-ec54b171-73b2-4c29-948b-0e8ad61306b7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Going to try to terminate instance {{(pid=124629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 13:59:26.975792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-ec54b171-73b2-4c29-948b-0e8ad61306b7 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 204 len: 0 microversion: 2.1 time: 0.552875 Jun 08 13:59:26.976428 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 503/1009] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 13:59:26 2022] DELETE /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 13:59:26.985059 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-363d44a9-b675-41c0-a3ed-e1d08abc7c0b tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:26.985668 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-363d44a9-b675-41c0-a3ed-e1d08abc7c0b tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:26.991641 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-363d44a9-b675-41c0-a3ed-e1d08abc7c0b tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:26.992111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-363d44a9-b675-41c0-a3ed-e1d08abc7c0b tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:26.992868 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-363d44a9-b675-41c0-a3ed-e1d08abc7c0b tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:26.993298 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-363d44a9-b675-41c0-a3ed-e1d08abc7c0b tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:27.124664 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-363d44a9-b675-41c0-a3ed-e1d08abc7c0b tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:27.132141 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-363d44a9-b675-41c0-a3ed-e1d08abc7c0b tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1471 microversion: 2.1 time: 0.150858 Jun 08 13:59:27.132703 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 507/1010] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:26 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:28.148978 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-519b3d00-7df0-4982-8bbe-6a827aaba839 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:28.149683 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-519b3d00-7df0-4982-8bbe-6a827aaba839 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:28.156170 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-519b3d00-7df0-4982-8bbe-6a827aaba839 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:28.156624 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-519b3d00-7df0-4982-8bbe-6a827aaba839 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:28.157392 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-519b3d00-7df0-4982-8bbe-6a827aaba839 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:28.157827 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-519b3d00-7df0-4982-8bbe-6a827aaba839 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:28.289285 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-519b3d00-7df0-4982-8bbe-6a827aaba839 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:28.306729 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-519b3d00-7df0-4982-8bbe-6a827aaba839 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1471 microversion: 2.1 time: 0.152556 Jun 08 13:59:28.306729 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 504/1011] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:28 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:28.781473 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-730956a5-9c79-42ea-b88d-f456bac0a215 req-f2a8cec5-f43e-4374-9827-2ade8129da1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d34e1f6-a2df-4f99-a8dd-66703601a6f7", "name": "network-vif-deleted", "tag": "310910f4-9dad-420d-a82d-e04427479dd5"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 13:59:28.792843 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-730956a5-9c79-42ea-b88d-f456bac0a215 req-f2a8cec5-f43e-4374-9827-2ade8129da1b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:28.793324 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-730956a5-9c79-42ea-b88d-f456bac0a215 req-f2a8cec5-f43e-4374-9827-2ade8129da1b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:28.805124 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-730956a5-9c79-42ea-b88d-f456bac0a215 req-f2a8cec5-f43e-4374-9827-2ade8129da1b service nova] Creating event network-vif-deleted:310910f4-9dad-420d-a82d-e04427479dd5 for instance 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 on hv-cinder-81914 Jun 08 13:59:28.810499 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-730956a5-9c79-42ea-b88d-f456bac0a215 req-f2a8cec5-f43e-4374-9827-2ade8129da1b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035581 Jun 08 13:59:28.814468 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 508/1012] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 13:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 13:59:29.314408 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:29.315022 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:29.321553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:29.322005 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:29.323561 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:29.324310 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:29.354884 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:29.355255 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:29.355701 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lazy-loading 'fault' on Instance uuid 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 13:59:29.395984 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6832ef66d864584943fd1435c3dcc27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ba93f28ab34253903b52621b23cb19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 13:59:29.403414 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-3b5c87b7-5f0f-4661-9296-e10137cb76e8 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 200 len: 1305 microversion: 2.1 time: 0.092916 Jun 08 13:59:29.403974 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 505/1013] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:29 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 13:59:30.421629 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 13:59:30.422342 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] [instance: 4d34e1f6-a2df-4f99-a8dd-66703601a6f7] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 13:59:30.428621 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:30.429080 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:30.429853 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 13:59:30.430297 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 13:59:30.443483 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] HTTP exception thrown: Instance 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 could not be found. Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Request method failure captured: Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 HTTP/1.1 Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKsvWAqiBe0dD-xCsnwpN_0gtVP78src_NW8jW6ReKnK4ht-QB6az7Fj2GU4q99QfmA2hN4dH_6QuJ5gv5uAAjGxbF4BYiM6VrXXri0IP2UBp2iEPJjNiXtqqw4BL94xGbSgfHde6wjEyHYhEtBlNpx7BNdCsRf_h-Pv25JfZfOXqyo Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: b2ba93f28ab34253903b52621b23cb19 Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-VolumesNegativeTest-1649415676 Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 13:59:30.445140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2ba93f28ab34253903b52621b23cb19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b2ba93f28ab34253903b52621b23cb19", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b2ba93f28ab34253903b52621b23cb19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b2ba93f28ab34253903b52621b23cb19"}]}] Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-VolumesNegativeTest-1649415676 Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: b2ba93f28ab34253903b52621b23cb19 Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-VolumesNegativeTest-1649415676 Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-VolumesNegativeTest-1649415676-project Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: b6832ef66d864584943fd1435c3dcc27 Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-VolumesNegativeTest-1649415676-project Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 could not be found. Jun 08 13:59:30.447058 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '4d34e1f6-a2df-4f99-a8dd-66703601a6f7'} Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 could not be found. Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 13:59:30.448137 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 could not be found. Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 could not be found. Jun 08 13:59:30.450503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 13:59:30.452517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] Returning 404 to user: Instance 4d34e1f6-a2df-4f99-a8dd-66703601a6f7 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 13:59:30.452517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-eff306a2-4102-46a1-bc41-831c55a35807 tempest-VolumesNegativeTest-1649415676 tempest-VolumesNegativeTest-1649415676-project] 10.222.0.55 "GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7" status: 404 len: 111 microversion: 2.1 time: 0.030062 Jun 08 13:59:30.452517 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 509/1014] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 13:59:30 2022] GET /compute/v2.1/servers/4d34e1f6-a2df-4f99-a8dd-66703601a6f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 14:00:00.630433 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:00.631671 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:00.824825 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7a6b6b45-e08c-43a7-9c03-9f7a32538138 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Action: 'create', calling method: .version_select at 0x7fe28936e700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2047968818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoNpudYL5lvS4u+SyJEAjfMon9yrd4i4Vn7HZNZjEAS/tqZ4IeeeWGVjJAZLWvGE8ZTHR9ECN5SEUiDcwAtsqaklXEy1o8bcY85hsMMiwL1qhEpniuF/XETTRO5ng8J4g=="}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:00:00.840875 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-7a6b6b45-e08c-43a7-9c03-9f7a32538138 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Getting quotas for project 935e40a140d74e528002c0bcfd1515aa. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 14:00:00.845036 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-7a6b6b45-e08c-43a7-9c03-9f7a32538138 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Getting quotas for user fc41110d12a047f58219b4cf2619f80d and project 935e40a140d74e528002c0bcfd1515aa. Resources: {'key_pairs'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 14:00:01.000817 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7a6b6b45-e08c-43a7-9c03-9f7a32538138 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.375740 Jun 08 14:00:01.002195 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 506/1015] 10.222.0.55 () {60 vars in 1158 bytes} [Wed Jun 8 14:00:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:00:19.411027 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-344565966", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2047968818", "security_groups": [{"name": "tempest-secgroup-smoke-1337554340"}], "block_device_mapping_v2": [{"uuid": "f2cd896c-0ad6-496d-9ceb-ecb3cf10d3a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a18d0c8-3777-47d9-8514-f63bd12afcbe"}]}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:00:19.419620 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=22 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:19.420306 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=42 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:19.525483 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] validate_networks() for [('8a18d0c8-3777-47d9-8514-f63bd12afcbe', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 14:00:19.986676 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 14:00:19.987097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 14:00:19.988126 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 14:00:19.988539 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 14:00:19.988949 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 14:00:19.997503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:19.997952 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:19.998745 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:19.999177 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:20.016351 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Getting quotas for project 935e40a140d74e528002c0bcfd1515aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 14:00:20.020356 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Getting quotas for user fc41110d12a047f58219b4cf2619f80d and project 935e40a140d74e528002c0bcfd1515aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 14:00:20.075540 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 14:00:20.077690 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2cd896c-0ad6-496d-9ceb-ecb3cf10d3a8',volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 14:00:20.519213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7b21ad3b-bcec-4490-a932-591c4250c61a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.112590 Jun 08 14:00:20.519929 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 510/1016] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 14:00:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 14:00:20.527488 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=4 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:20.528555 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:20.532522 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b715b556-e25e-492f-9158-82ef353f5fc1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:20.533138 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b715b556-e25e-492f-9158-82ef353f5fc1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:20.593170 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b715b556-e25e-492f-9158-82ef353f5fc1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:20.604576 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b715b556-e25e-492f-9158-82ef353f5fc1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1094 microversion: 2.1 time: 0.078650 Jun 08 14:00:20.605153 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 507/1017] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:20 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:21.622229 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-99a97bc2-e275-446c-812a-97e02f29a6a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:21.622853 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-99a97bc2-e275-446c-812a-97e02f29a6a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:21.629777 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-99a97bc2-e275-446c-812a-97e02f29a6a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:21.637562 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-99a97bc2-e275-446c-812a-97e02f29a6a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:21.637562 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-99a97bc2-e275-446c-812a-97e02f29a6a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:21.637562 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-99a97bc2-e275-446c-812a-97e02f29a6a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:21.693039 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-99a97bc2-e275-446c-812a-97e02f29a6a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:21.700460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-99a97bc2-e275-446c-812a-97e02f29a6a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1144 microversion: 2.1 time: 0.082852 Jun 08 14:00:21.705003 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 511/1018] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:21 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:22.716505 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-bbd5b9cb-2a35-4ff7-a61d-c7b4c9bad8ac tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:22.717126 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-bbd5b9cb-2a35-4ff7-a61d-c7b4c9bad8ac tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:22.724911 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bbd5b9cb-2a35-4ff7-a61d-c7b4c9bad8ac tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:22.725363 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bbd5b9cb-2a35-4ff7-a61d-c7b4c9bad8ac tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:22.726389 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bbd5b9cb-2a35-4ff7-a61d-c7b4c9bad8ac tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:22.726831 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-bbd5b9cb-2a35-4ff7-a61d-c7b4c9bad8ac tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:22.792736 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-bbd5b9cb-2a35-4ff7-a61d-c7b4c9bad8ac tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:22.800707 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-bbd5b9cb-2a35-4ff7-a61d-c7b4c9bad8ac tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1192 microversion: 2.1 time: 0.087976 Jun 08 14:00:22.802010 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 508/1019] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:22 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:23.821000 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-698a6a63-1643-4669-a3ee-972ed4821bb6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:23.821722 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-698a6a63-1643-4669-a3ee-972ed4821bb6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:23.831350 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-698a6a63-1643-4669-a3ee-972ed4821bb6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:23.833328 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-698a6a63-1643-4669-a3ee-972ed4821bb6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:23.833716 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-698a6a63-1643-4669-a3ee-972ed4821bb6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:23.835352 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-698a6a63-1643-4669-a3ee-972ed4821bb6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:23.983913 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-698a6a63-1643-4669-a3ee-972ed4821bb6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:23.994327 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-698a6a63-1643-4669-a3ee-972ed4821bb6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1278 microversion: 2.1 time: 0.177169 Jun 08 14:00:23.995239 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 512/1020] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:23 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:24.844035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-f51438fe-4457-46c4-96ad-ba573f654a22 req-520171d4-3028-444b-a195-11baa3341056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3f14a4-b72e-4500-b1bd-2dca9d571995", "tag": "474f2939-0696-4f5c-838a-4d79c7832c70"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:00:24.844035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-f51438fe-4457-46c4-96ad-ba573f654a22 req-520171d4-3028-444b-a195-11baa3341056 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:24.844035 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-f51438fe-4457-46c4-96ad-ba573f654a22 req-520171d4-3028-444b-a195-11baa3341056 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:24.854911 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-f51438fe-4457-46c4-96ad-ba573f654a22 req-520171d4-3028-444b-a195-11baa3341056 service nova] Creating event network-changed:474f2939-0696-4f5c-838a-4d79c7832c70 for instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 on hv-cinder-81914 Jun 08 14:00:24.860045 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-f51438fe-4457-46c4-96ad-ba573f654a22 req-520171d4-3028-444b-a195-11baa3341056 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030442 Jun 08 14:00:24.860849 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 509/1021] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:00:25.018608 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a77c7355-9545-4b56-b84c-0b982f4aa9d5 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:25.019204 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a77c7355-9545-4b56-b84c-0b982f4aa9d5 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:25.025666 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a77c7355-9545-4b56-b84c-0b982f4aa9d5 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:25.026119 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a77c7355-9545-4b56-b84c-0b982f4aa9d5 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:25.026893 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a77c7355-9545-4b56-b84c-0b982f4aa9d5 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:25.027325 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a77c7355-9545-4b56-b84c-0b982f4aa9d5 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:25.163809 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a77c7355-9545-4b56-b84c-0b982f4aa9d5 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:25.171420 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a77c7355-9545-4b56-b84c-0b982f4aa9d5 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.156615 Jun 08 14:00:25.172014 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 513/1022] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:25 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:26.189587 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b2c38707-e96a-4791-b39e-f74536c3796d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:26.190317 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b2c38707-e96a-4791-b39e-f74536c3796d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:26.197052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b2c38707-e96a-4791-b39e-f74536c3796d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:26.197498 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b2c38707-e96a-4791-b39e-f74536c3796d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:26.198253 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b2c38707-e96a-4791-b39e-f74536c3796d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:26.198688 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b2c38707-e96a-4791-b39e-f74536c3796d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:26.330157 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b2c38707-e96a-4791-b39e-f74536c3796d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:26.338298 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b2c38707-e96a-4791-b39e-f74536c3796d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.153303 Jun 08 14:00:26.338864 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 510/1023] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:26 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:27.356835 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-fdd0fa4b-6f64-468a-a16a-870f6a81159a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:27.356835 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-fdd0fa4b-6f64-468a-a16a-870f6a81159a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:27.362349 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fdd0fa4b-6f64-468a-a16a-870f6a81159a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:27.362797 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fdd0fa4b-6f64-468a-a16a-870f6a81159a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:27.363577 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fdd0fa4b-6f64-468a-a16a-870f6a81159a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:27.364018 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fdd0fa4b-6f64-468a-a16a-870f6a81159a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:27.493248 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-fdd0fa4b-6f64-468a-a16a-870f6a81159a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:27.500668 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-fdd0fa4b-6f64-468a-a16a-870f6a81159a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.149329 Jun 08 14:00:27.501240 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 514/1024] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:27 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:28.520819 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-f63dcabc-f9b1-488d-8604-3129b8043132 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:28.521447 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-f63dcabc-f9b1-488d-8604-3129b8043132 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:28.528443 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f63dcabc-f9b1-488d-8604-3129b8043132 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:28.528885 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f63dcabc-f9b1-488d-8604-3129b8043132 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:28.529644 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f63dcabc-f9b1-488d-8604-3129b8043132 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:28.530074 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-f63dcabc-f9b1-488d-8604-3129b8043132 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:28.662103 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-f63dcabc-f9b1-488d-8604-3129b8043132 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:28.670388 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-f63dcabc-f9b1-488d-8604-3129b8043132 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.153476 Jun 08 14:00:28.670953 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 511/1025] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:28 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:29.687294 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-9245d969-4753-42f7-a0d1-758d88837a3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:29.687873 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-9245d969-4753-42f7-a0d1-758d88837a3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:29.694960 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9245d969-4753-42f7-a0d1-758d88837a3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:29.695413 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9245d969-4753-42f7-a0d1-758d88837a3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:29.696229 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9245d969-4753-42f7-a0d1-758d88837a3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:29.696663 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-9245d969-4753-42f7-a0d1-758d88837a3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:29.826369 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-9245d969-4753-42f7-a0d1-758d88837a3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:29.833940 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-9245d969-4753-42f7-a0d1-758d88837a3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.150774 Jun 08 14:00:29.834511 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 515/1026] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:29 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:30.851190 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-221ce3c1-a027-4773-80d5-1eaf943355de tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:30.851810 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-221ce3c1-a027-4773-80d5-1eaf943355de tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:30.854370 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:30.859335 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-221ce3c1-a027-4773-80d5-1eaf943355de tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:30.859845 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-221ce3c1-a027-4773-80d5-1eaf943355de tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:30.860692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-221ce3c1-a027-4773-80d5-1eaf943355de tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:30.866712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-221ce3c1-a027-4773-80d5-1eaf943355de tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:30.993296 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-221ce3c1-a027-4773-80d5-1eaf943355de tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:31.001275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-221ce3c1-a027-4773-80d5-1eaf943355de tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.154415 Jun 08 14:00:31.004346 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 512/1027] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:30 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:32.018780 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-b365def7-5902-4265-9deb-87104e436982 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:32.019398 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-b365def7-5902-4265-9deb-87104e436982 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:32.021903 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:32.022567 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=6 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:00:32.027420 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b365def7-5902-4265-9deb-87104e436982 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:32.027878 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b365def7-5902-4265-9deb-87104e436982 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:32.028669 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b365def7-5902-4265-9deb-87104e436982 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:32.029108 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-b365def7-5902-4265-9deb-87104e436982 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:32.165109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-b365def7-5902-4265-9deb-87104e436982 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:32.172644 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-b365def7-5902-4265-9deb-87104e436982 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.157752 Jun 08 14:00:32.173202 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 516/1028] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:32 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:33.189265 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d9e07f47-bf58-4a30-9023-f42ac2d65c4c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:33.189927 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d9e07f47-bf58-4a30-9023-f42ac2d65c4c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:33.196627 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d9e07f47-bf58-4a30-9023-f42ac2d65c4c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:33.197084 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d9e07f47-bf58-4a30-9023-f42ac2d65c4c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:33.197854 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d9e07f47-bf58-4a30-9023-f42ac2d65c4c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:33.198298 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d9e07f47-bf58-4a30-9023-f42ac2d65c4c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:33.325407 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d9e07f47-bf58-4a30-9023-f42ac2d65c4c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:33.333411 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d9e07f47-bf58-4a30-9023-f42ac2d65c4c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.148036 Jun 08 14:00:33.333988 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 513/1029] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:33 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:34.350699 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-3f618007-47e3-428c-aedb-9224f461ef65 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:34.351582 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-3f618007-47e3-428c-aedb-9224f461ef65 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:34.357787 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3f618007-47e3-428c-aedb-9224f461ef65 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:34.358241 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3f618007-47e3-428c-aedb-9224f461ef65 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:34.359012 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3f618007-47e3-428c-aedb-9224f461ef65 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:34.359454 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-3f618007-47e3-428c-aedb-9224f461ef65 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:34.495741 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-3f618007-47e3-428c-aedb-9224f461ef65 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:34.503259 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-3f618007-47e3-428c-aedb-9224f461ef65 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.156824 Jun 08 14:00:34.503820 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 517/1030] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:34 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:35.521801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-8b6bf499-be35-4f3c-89cb-72d6aff4cf9b tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:35.522355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-8b6bf499-be35-4f3c-89cb-72d6aff4cf9b tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:35.528965 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8b6bf499-be35-4f3c-89cb-72d6aff4cf9b tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:35.529414 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8b6bf499-be35-4f3c-89cb-72d6aff4cf9b tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:35.530187 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8b6bf499-be35-4f3c-89cb-72d6aff4cf9b tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:35.530622 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-8b6bf499-be35-4f3c-89cb-72d6aff4cf9b tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:35.664567 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-8b6bf499-be35-4f3c-89cb-72d6aff4cf9b tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:35.671946 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-8b6bf499-be35-4f3c-89cb-72d6aff4cf9b tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.154989 Jun 08 14:00:35.672591 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 514/1031] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:35 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:36.548092 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-c5fdebd1-0f23-4903-be93-4a6829c2370a req-66813fce-85d1-4351-92a9-170503db46c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3f14a4-b72e-4500-b1bd-2dca9d571995", "name": "network-vif-plugged", "status": "completed", "tag": "474f2939-0696-4f5c-838a-4d79c7832c70"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:00:36.556662 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-c5fdebd1-0f23-4903-be93-4a6829c2370a req-66813fce-85d1-4351-92a9-170503db46c3 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:36.557105 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-c5fdebd1-0f23-4903-be93-4a6829c2370a req-66813fce-85d1-4351-92a9-170503db46c3 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:36.567703 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-c5fdebd1-0f23-4903-be93-4a6829c2370a req-66813fce-85d1-4351-92a9-170503db46c3 service nova] Creating event network-vif-plugged:474f2939-0696-4f5c-838a-4d79c7832c70 for instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 on hv-cinder-81914 Jun 08 14:00:36.572889 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-c5fdebd1-0f23-4903-be93-4a6829c2370a req-66813fce-85d1-4351-92a9-170503db46c3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028620 Jun 08 14:00:36.573467 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 518/1032] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:00:36.689896 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-2a564edd-02f7-4d40-a7e4-295b1d8b5790 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:36.690523 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-2a564edd-02f7-4d40-a7e4-295b1d8b5790 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:36.697863 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2a564edd-02f7-4d40-a7e4-295b1d8b5790 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:36.698321 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2a564edd-02f7-4d40-a7e4-295b1d8b5790 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:36.699092 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2a564edd-02f7-4d40-a7e4-295b1d8b5790 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:36.699530 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-2a564edd-02f7-4d40-a7e4-295b1d8b5790 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:36.830363 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-2a564edd-02f7-4d40-a7e4-295b1d8b5790 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:36.840863 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-2a564edd-02f7-4d40-a7e4-295b1d8b5790 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.154788 Jun 08 14:00:36.841453 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 515/1033] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:36 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:37.858984 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-023efff0-c856-460b-a29b-86d07d856378 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:37.859682 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-023efff0-c856-460b-a29b-86d07d856378 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:37.865876 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-023efff0-c856-460b-a29b-86d07d856378 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:37.866937 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-023efff0-c856-460b-a29b-86d07d856378 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:37.867699 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-023efff0-c856-460b-a29b-86d07d856378 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:37.868159 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-023efff0-c856-460b-a29b-86d07d856378 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:38.002182 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-023efff0-c856-460b-a29b-86d07d856378 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:38.010376 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-023efff0-c856-460b-a29b-86d07d856378 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1266 microversion: 2.1 time: 0.156081 Jun 08 14:00:38.010937 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 519/1034] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:37 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:39.027948 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-5241b9aa-b1a2-4192-901c-695e1df40363 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:39.028653 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-5241b9aa-b1a2-4192-901c-695e1df40363 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:39.035113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5241b9aa-b1a2-4192-901c-695e1df40363 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:39.035586 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5241b9aa-b1a2-4192-901c-695e1df40363 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:39.036390 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5241b9aa-b1a2-4192-901c-695e1df40363 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:39.036832 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-5241b9aa-b1a2-4192-901c-695e1df40363 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:39.165253 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-5241b9aa-b1a2-4192-901c-695e1df40363 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:39.172790 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-5241b9aa-b1a2-4192-901c-695e1df40363 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1453 microversion: 2.1 time: 0.149308 Jun 08 14:00:39.173360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 516/1035] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:39 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:39.188629 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-8f03ed58-d96d-41b7-a75b-2c5bf6a96ce3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:00:39.189265 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-8f03ed58-d96d-41b7-a75b-2c5bf6a96ce3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:00:39.195744 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f03ed58-d96d-41b7-a75b-2c5bf6a96ce3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:39.196244 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f03ed58-d96d-41b7-a75b-2c5bf6a96ce3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:39.197015 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f03ed58-d96d-41b7-a75b-2c5bf6a96ce3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:39.197461 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-8f03ed58-d96d-41b7-a75b-2c5bf6a96ce3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:39.328530 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-8f03ed58-d96d-41b7-a75b-2c5bf6a96ce3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:00:39.336707 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-8f03ed58-d96d-41b7-a75b-2c5bf6a96ce3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1453 microversion: 2.1 time: 0.151210 Jun 08 14:00:39.337279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 520/1036] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:00:39 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:00:41.659562 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-60d13049-844c-47b1-9ecd-548cacbe5186 req-6aa8686a-7c0b-4858-b25d-1901f116ee16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3f14a4-b72e-4500-b1bd-2dca9d571995", "tag": "474f2939-0696-4f5c-838a-4d79c7832c70"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:00:41.668144 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-60d13049-844c-47b1-9ecd-548cacbe5186 req-6aa8686a-7c0b-4858-b25d-1901f116ee16 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:00:41.668594 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-60d13049-844c-47b1-9ecd-548cacbe5186 req-6aa8686a-7c0b-4858-b25d-1901f116ee16 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:00:41.680154 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-60d13049-844c-47b1-9ecd-548cacbe5186 req-6aa8686a-7c0b-4858-b25d-1901f116ee16 service nova] Creating event network-changed:474f2939-0696-4f5c-838a-4d79c7832c70 for instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 on hv-cinder-81914 Jun 08 14:00:41.685771 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-60d13049-844c-47b1-9ecd-548cacbe5186 req-6aa8686a-7c0b-4858-b25d-1901f116ee16 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089540 Jun 08 14:00:41.686623 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 517/1037] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:02:04.768391 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:02:04.769048 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Wed Jun 8 14:02:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:02:35.915064 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8be4cab1-25a6-4085-8045-e629fa595ddd] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 08 14:02:35.915764 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:02:35.916511 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=58 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:02:35.920312 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d32a9654-f3e5-4896-9fc4-3fd3e4596ee7 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:35.920801 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d32a9654-f3e5-4896-9fc4-3fd3e4596ee7 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:35.926594 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d32a9654-f3e5-4896-9fc4-3fd3e4596ee7 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:35.927072 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d32a9654-f3e5-4896-9fc4-3fd3e4596ee7 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:35.927826 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d32a9654-f3e5-4896-9fc4-3fd3e4596ee7 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:35.928283 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d32a9654-f3e5-4896-9fc4-3fd3e4596ee7 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:35.952268 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d32a9654-f3e5-4896-9fc4-3fd3e4596ee7 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Going to try to terminate instance {{(pid=124628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 14:02:36.203183 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d32a9654-f3e5-4896-9fc4-3fd3e4596ee7 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 204 len: 0 microversion: 2.1 time: 0.289778 Jun 08 14:02:36.203687 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 521/1038] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 14:02:35 2022] DELETE /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 14:02:36.210747 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=24 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:02:36.213218 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=52 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:02:36.215565 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fe7adcb6-a21c-42c8-9dd6-a6adacc62566 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:36.216306 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fe7adcb6-a21c-42c8-9dd6-a6adacc62566 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:36.222961 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fe7adcb6-a21c-42c8-9dd6-a6adacc62566 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:36.223404 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fe7adcb6-a21c-42c8-9dd6-a6adacc62566 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:36.224203 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fe7adcb6-a21c-42c8-9dd6-a6adacc62566 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:36.224637 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fe7adcb6-a21c-42c8-9dd6-a6adacc62566 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:36.409830 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-fe7adcb6-a21c-42c8-9dd6-a6adacc62566 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:36.417365 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fe7adcb6-a21c-42c8-9dd6-a6adacc62566 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1578 microversion: 2.1 time: 0.208570 Jun 08 14:02:36.417939 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 518/1039] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:36 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:37.434609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d3736781-0aa4-4635-929d-ccfb4acc24b1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:37.435235 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d3736781-0aa4-4635-929d-ccfb4acc24b1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:37.442987 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d3736781-0aa4-4635-929d-ccfb4acc24b1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:37.443441 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d3736781-0aa4-4635-929d-ccfb4acc24b1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:37.444238 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d3736781-0aa4-4635-929d-ccfb4acc24b1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:37.444705 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d3736781-0aa4-4635-929d-ccfb4acc24b1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:37.449956 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO oslo.messaging._drivers.impl_rabbit [-] [8be4cab1-25a6-4085-8045-e629fa595ddd] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 51784. Jun 08 14:02:37.632094 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d3736781-0aa4-4635-929d-ccfb4acc24b1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:37.639531 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d3736781-0aa4-4635-929d-ccfb4acc24b1 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1578 microversion: 2.1 time: 0.209262 Jun 08 14:02:37.640160 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 522/1040] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:37 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:38.580424 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-4cd53e47-c606-4b58-8aa5-37a9d57cc8c6 req-733143bc-5734-4923-9a14-aadda742b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3f14a4-b72e-4500-b1bd-2dca9d571995", "name": "network-vif-deleted", "tag": "474f2939-0696-4f5c-838a-4d79c7832c70"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:02:38.590537 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-4cd53e47-c606-4b58-8aa5-37a9d57cc8c6 req-733143bc-5734-4923-9a14-aadda742b1ab service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:38.591159 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-4cd53e47-c606-4b58-8aa5-37a9d57cc8c6 req-733143bc-5734-4923-9a14-aadda742b1ab service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:38.603520 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-4cd53e47-c606-4b58-8aa5-37a9d57cc8c6 req-733143bc-5734-4923-9a14-aadda742b1ab service nova] Creating event network-vif-deleted:474f2939-0696-4f5c-838a-4d79c7832c70 for instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 on hv-cinder-81914 Jun 08 14:02:38.608859 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-4cd53e47-c606-4b58-8aa5-37a9d57cc8c6 req-733143bc-5734-4923-9a14-aadda742b1ab service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032967 Jun 08 14:02:38.609465 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 519/1041] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 08 14:02:38.659675 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7216737a-f419-4869-8939-1a564d8435b6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:38.660503 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7216737a-f419-4869-8939-1a564d8435b6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:38.678749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7216737a-f419-4869-8939-1a564d8435b6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:38.678749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7216737a-f419-4869-8939-1a564d8435b6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:38.678749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7216737a-f419-4869-8939-1a564d8435b6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:38.678749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7216737a-f419-4869-8939-1a564d8435b6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:38.742313 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7216737a-f419-4869-8939-1a564d8435b6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:38.751101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7216737a-f419-4869-8939-1a564d8435b6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1510 microversion: 2.1 time: 0.096997 Jun 08 14:02:38.752631 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 523/1042] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:38 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1510 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:39.773331 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:39.774007 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:39.780716 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:39.781172 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:39.781976 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:39.782422 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:39.814276 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:39.814836 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:39.815293 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.objects.instance [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lazy-loading 'fault' on Instance uuid 7d3f14a4-b72e-4500-b1bd-2dca9d571995 {{(pid=124629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 08 14:02:39.859792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:39.865421 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e823024c-fa1e-4d79-b96b-624dba73193a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 200 len: 1184 microversion: 2.1 time: 0.096359 Jun 08 14:02:39.865990 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 520/1043] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:39 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 1184 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:40.882951 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:40.883571 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:40.890070 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:40.890529 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:40.891300 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:40.891751 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:40.905111 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] HTTP exception thrown: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Request method failure captured: Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 HTTP/1.1 Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKtar-qaDqzNowsQnaGaOCJu8uDVUTtWJNxs253Jx-yv-O5TsA-fTEXp8QM_7CeO2OnQnUFuBHO0eAY0Na6p1OvqpomIBGZ0iy-erVRZa9WrAhMLCPatqSWGWVumT72g2QCX8JPpeuM50ryqLIeRaq1L7MuoSwYyJfNsQIPJp2jv4Lw Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 14:02:40.913587 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_935e40a140d74e528002c0bcfd1515aa", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}] Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-TestVolumeBootPattern-704636513 Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: fc41110d12a047f58219b4cf2619f80d Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:02:40.915337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '7d3f14a4-b72e-4500-b1bd-2dca9d571995'} Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 14:02:40.916407 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:02:40.918460 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:02:40.919968 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Returning 404 to user: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 14:02:40.919968 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1a292c34-9346-461f-817a-b6ad77e0e842 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 404 len: 111 microversion: 2.1 time: 0.029231 Jun 08 14:02:40.919968 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 524/1044] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:40 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 14:02:40.955907 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1924030654", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2047968818", "security_groups": [{"name": "tempest-secgroup-smoke-1337554340"}], "block_device_mapping_v2": [{"uuid": "f2cd896c-0ad6-496d-9ceb-ecb3cf10d3a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a18d0c8-3777-47d9-8514-f63bd12afcbe"}]}} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:02:41.066144 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.network.neutron [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] validate_networks() for [('8a18d0c8-3777-47d9-8514-f63bd12afcbe', None, None, None, None, None)] {{(pid=124629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 14:02:41.481890 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Flavor limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 14:02:41.482324 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Image limits 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 14:02:41.482803 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Flavor pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 14:02:41.483219 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Image pref 0:0:0 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 14:02:41.483634 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.virt.hardware [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 14:02:41.492944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:41.493396 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:41.494228 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:41.494675 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:41.511406 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Getting quotas for project 935e40a140d74e528002c0bcfd1515aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 14:02:41.515340 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.quota [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Getting quotas for user fc41110d12a047f58219b4cf2619f80d and project 935e40a140d74e528002c0bcfd1515aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 14:02:41.575322 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Going to run 1 instances... {{(pid=124629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 14:02:41.577553 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2cd896c-0ad6-496d-9ceb-ecb3cf10d3a8',volume_size=None,volume_type=None)] {{(pid=124629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 14:02:41.965016 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-fbbd7eb2-1b7b-428c-b71d-08fe800382a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.013540 Jun 08 14:02:41.965792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 521/1045] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 14:02:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 14:02:41.975808 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-ee95944b-9e2e-45ad-bb03-b42dbeca8aea tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:41.976465 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-ee95944b-9e2e-45ad-bb03-b42dbeca8aea tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:42.033552 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-ee95944b-9e2e-45ad-bb03-b42dbeca8aea tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:42.040909 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-ee95944b-9e2e-45ad-bb03-b42dbeca8aea tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1095 microversion: 2.1 time: 0.068983 Jun 08 14:02:42.041464 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 525/1046] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:41 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:43.058584 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-90b85a66-0291-45a4-a730-b973dea8a91f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:43.059166 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-90b85a66-0291-45a4-a730-b973dea8a91f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:43.066516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-90b85a66-0291-45a4-a730-b973dea8a91f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:43.066516 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-90b85a66-0291-45a4-a730-b973dea8a91f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:43.066862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-90b85a66-0291-45a4-a730-b973dea8a91f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:43.067306 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-90b85a66-0291-45a4-a730-b973dea8a91f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:43.133608 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-90b85a66-0291-45a4-a730-b973dea8a91f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:43.141405 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-90b85a66-0291-45a4-a730-b973dea8a91f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1137 microversion: 2.1 time: 0.087226 Jun 08 14:02:43.146673 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 522/1047] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:43 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:44.159898 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f8d2303e-1e03-43a5-90eb-0c46a1c05be0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:44.160567 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f8d2303e-1e03-43a5-90eb-0c46a1c05be0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:44.167279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f8d2303e-1e03-43a5-90eb-0c46a1c05be0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:44.167741 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f8d2303e-1e03-43a5-90eb-0c46a1c05be0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:44.168591 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f8d2303e-1e03-43a5-90eb-0c46a1c05be0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:44.169040 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f8d2303e-1e03-43a5-90eb-0c46a1c05be0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:44.234289 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-f8d2303e-1e03-43a5-90eb-0c46a1c05be0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:44.242941 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f8d2303e-1e03-43a5-90eb-0c46a1c05be0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1211 microversion: 2.1 time: 0.087970 Jun 08 14:02:44.243848 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 526/1048] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:44 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:45.259987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-a2e5d426-74c8-4f23-8ca0-df5246fa2b15 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:45.264253 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-a2e5d426-74c8-4f23-8ca0-df5246fa2b15 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:45.275408 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2e5d426-74c8-4f23-8ca0-df5246fa2b15 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:45.275869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2e5d426-74c8-4f23-8ca0-df5246fa2b15 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:45.276712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2e5d426-74c8-4f23-8ca0-df5246fa2b15 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:45.277159 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-a2e5d426-74c8-4f23-8ca0-df5246fa2b15 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:45.419216 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-a2e5d426-74c8-4f23-8ca0-df5246fa2b15 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:45.427985 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-a2e5d426-74c8-4f23-8ca0-df5246fa2b15 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.171902 Jun 08 14:02:45.430591 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 523/1049] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:45 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:45.505172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [req-047d484a-b1fd-49ce-b032-7154072a75bb req-fd8f2487-e89d-4182-8bc7-2d2b7c5f25fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8605b8d6-81fd-4f0b-b353-4a82d040f2dc", "tag": "510c9a79-bb51-4447-a8b8-dec89c386669"}]} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:02:45.514110 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-047d484a-b1fd-49ce-b032-7154072a75bb req-fd8f2487-e89d-4182-8bc7-2d2b7c5f25fd service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:45.514628 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [req-047d484a-b1fd-49ce-b032-7154072a75bb req-fd8f2487-e89d-4182-8bc7-2d2b7c5f25fd service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:45.526810 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.compute.server_external_events [req-047d484a-b1fd-49ce-b032-7154072a75bb req-fd8f2487-e89d-4182-8bc7-2d2b7c5f25fd service nova] Creating event network-changed:510c9a79-bb51-4447-a8b8-dec89c386669 for instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc on hv-cinder-81914 Jun 08 14:02:45.532097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [req-047d484a-b1fd-49ce-b032-7154072a75bb req-fd8f2487-e89d-4182-8bc7-2d2b7c5f25fd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031194 Jun 08 14:02:45.536315 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 527/1050] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:02:46.130789 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:02:46.131037 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Wed Jun 8 14:02:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:02:46.445723 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-4fc5c7ec-5af2-456e-a059-e375ba6d05ef tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:46.446312 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-4fc5c7ec-5af2-456e-a059-e375ba6d05ef tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:46.452747 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4fc5c7ec-5af2-456e-a059-e375ba6d05ef tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:46.453215 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4fc5c7ec-5af2-456e-a059-e375ba6d05ef tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:46.453982 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4fc5c7ec-5af2-456e-a059-e375ba6d05ef tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:46.455118 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-4fc5c7ec-5af2-456e-a059-e375ba6d05ef tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:46.588605 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-4fc5c7ec-5af2-456e-a059-e375ba6d05ef tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:46.596029 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-4fc5c7ec-5af2-456e-a059-e375ba6d05ef tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.154252 Jun 08 14:02:46.596630 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 524/1051] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:46 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:47.614052 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d1e4f408-36d6-4a25-96ef-17caecb0b9b0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:47.614798 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d1e4f408-36d6-4a25-96ef-17caecb0b9b0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:47.620992 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d1e4f408-36d6-4a25-96ef-17caecb0b9b0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:47.621448 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d1e4f408-36d6-4a25-96ef-17caecb0b9b0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:47.622226 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d1e4f408-36d6-4a25-96ef-17caecb0b9b0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:47.622668 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d1e4f408-36d6-4a25-96ef-17caecb0b9b0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:47.757012 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d1e4f408-36d6-4a25-96ef-17caecb0b9b0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:47.764486 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d1e4f408-36d6-4a25-96ef-17caecb0b9b0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.155308 Jun 08 14:02:47.765047 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 528/1052] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:47 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:48.781667 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-16071a29-2cb4-4f16-af04-7e950513200f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:48.782292 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-16071a29-2cb4-4f16-af04-7e950513200f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:48.790019 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16071a29-2cb4-4f16-af04-7e950513200f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:48.790470 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16071a29-2cb4-4f16-af04-7e950513200f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:48.791239 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16071a29-2cb4-4f16-af04-7e950513200f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:48.791679 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-16071a29-2cb4-4f16-af04-7e950513200f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:48.920873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-16071a29-2cb4-4f16-af04-7e950513200f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:48.928360 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-16071a29-2cb4-4f16-af04-7e950513200f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.150550 Jun 08 14:02:48.928920 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 525/1053] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:48 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:49.946336 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-af9273e1-0516-4287-9704-8a4755ff61a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:49.946995 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-af9273e1-0516-4287-9704-8a4755ff61a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:49.953355 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-af9273e1-0516-4287-9704-8a4755ff61a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:49.953813 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-af9273e1-0516-4287-9704-8a4755ff61a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:49.954586 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-af9273e1-0516-4287-9704-8a4755ff61a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:49.955033 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-af9273e1-0516-4287-9704-8a4755ff61a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:50.089860 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-af9273e1-0516-4287-9704-8a4755ff61a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:50.097932 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-af9273e1-0516-4287-9704-8a4755ff61a8 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.155687 Jun 08 14:02:50.098495 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 529/1054] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:49 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:51.115443 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-7fd78c39-9701-4279-8513-6c37e0188c1d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:51.116081 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-7fd78c39-9701-4279-8513-6c37e0188c1d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:51.122815 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7fd78c39-9701-4279-8513-6c37e0188c1d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:51.123260 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7fd78c39-9701-4279-8513-6c37e0188c1d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:51.124020 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7fd78c39-9701-4279-8513-6c37e0188c1d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:51.124494 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-7fd78c39-9701-4279-8513-6c37e0188c1d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:51.252923 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-7fd78c39-9701-4279-8513-6c37e0188c1d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:51.260260 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-7fd78c39-9701-4279-8513-6c37e0188c1d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.149384 Jun 08 14:02:51.260830 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 526/1055] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:51 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:52.276942 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bd4b1905-a456-4c19-8544-be4969fdc9a3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:52.277552 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bd4b1905-a456-4c19-8544-be4969fdc9a3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:52.279910 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:02:52.284731 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd4b1905-a456-4c19-8544-be4969fdc9a3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:52.285178 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd4b1905-a456-4c19-8544-be4969fdc9a3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:52.285943 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd4b1905-a456-4c19-8544-be4969fdc9a3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:52.286377 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bd4b1905-a456-4c19-8544-be4969fdc9a3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:52.418825 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-bd4b1905-a456-4c19-8544-be4969fdc9a3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:52.427068 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bd4b1905-a456-4c19-8544-be4969fdc9a3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.153905 Jun 08 14:02:52.427652 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 530/1056] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:52 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:53.444801 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b3a7db13-8e5b-4401-9b56-334c6491b52c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:53.445417 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b3a7db13-8e5b-4401-9b56-334c6491b52c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:53.447258 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:02:53.447963 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=6 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:02:53.453371 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b3a7db13-8e5b-4401-9b56-334c6491b52c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:53.453826 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b3a7db13-8e5b-4401-9b56-334c6491b52c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:53.454951 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b3a7db13-8e5b-4401-9b56-334c6491b52c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:53.455756 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b3a7db13-8e5b-4401-9b56-334c6491b52c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:53.589274 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b3a7db13-8e5b-4401-9b56-334c6491b52c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:53.597144 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b3a7db13-8e5b-4401-9b56-334c6491b52c tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.156219 Jun 08 14:02:53.597712 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 527/1057] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:53 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:54.614334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5c80f0f9-3d91-4c5a-98ce-e8a9f1692a37 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:54.614978 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5c80f0f9-3d91-4c5a-98ce-e8a9f1692a37 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:54.621470 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5c80f0f9-3d91-4c5a-98ce-e8a9f1692a37 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:54.621918 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5c80f0f9-3d91-4c5a-98ce-e8a9f1692a37 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:54.622674 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5c80f0f9-3d91-4c5a-98ce-e8a9f1692a37 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:54.623108 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5c80f0f9-3d91-4c5a-98ce-e8a9f1692a37 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:54.759024 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-5c80f0f9-3d91-4c5a-98ce-e8a9f1692a37 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:54.766442 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5c80f0f9-3d91-4c5a-98ce-e8a9f1692a37 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.156070 Jun 08 14:02:54.767086 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 531/1058] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:54 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 14:02:55.784640 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-b3d23355-5572-411c-aa10-df8f5f9a6d58 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:55.785258 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-b3d23355-5572-411c-aa10-df8f5f9a6d58 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:55.791770 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b3d23355-5572-411c-aa10-df8f5f9a6d58 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:55.792252 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b3d23355-5572-411c-aa10-df8f5f9a6d58 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:55.793018 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b3d23355-5572-411c-aa10-df8f5f9a6d58 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:55.793458 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-b3d23355-5572-411c-aa10-df8f5f9a6d58 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:55.923019 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-b3d23355-5572-411c-aa10-df8f5f9a6d58 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:55.931032 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-b3d23355-5572-411c-aa10-df8f5f9a6d58 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.151160 Jun 08 14:02:55.931607 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 528/1059] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:55 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:56.948620 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-a65ec38f-90c5-4d2e-b941-41b46cd86097 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:56.949251 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-a65ec38f-90c5-4d2e-b941-41b46cd86097 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:56.955761 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a65ec38f-90c5-4d2e-b941-41b46cd86097 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:56.956262 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a65ec38f-90c5-4d2e-b941-41b46cd86097 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:56.957039 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a65ec38f-90c5-4d2e-b941-41b46cd86097 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:56.957482 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-a65ec38f-90c5-4d2e-b941-41b46cd86097 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:57.093040 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-a65ec38f-90c5-4d2e-b941-41b46cd86097 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:57.101304 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-a65ec38f-90c5-4d2e-b941-41b46cd86097 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.156467 Jun 08 14:02:57.101909 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 532/1060] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:56 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:57.186038 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-919548f8-3b31-46e7-a259-563a5b2feec7 req-60a63162-fcc5-41cc-98e7-587ee4ff64f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8605b8d6-81fd-4f0b-b353-4a82d040f2dc", "name": "network-vif-plugged", "status": "completed", "tag": "510c9a79-bb51-4447-a8b8-dec89c386669"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:02:57.196175 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-919548f8-3b31-46e7-a259-563a5b2feec7 req-60a63162-fcc5-41cc-98e7-587ee4ff64f6 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:57.196621 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-919548f8-3b31-46e7-a259-563a5b2feec7 req-60a63162-fcc5-41cc-98e7-587ee4ff64f6 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:57.210073 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-919548f8-3b31-46e7-a259-563a5b2feec7 req-60a63162-fcc5-41cc-98e7-587ee4ff64f6 service nova] Creating event network-vif-plugged:510c9a79-bb51-4447-a8b8-dec89c386669 for instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc on hv-cinder-81914 Jun 08 14:02:57.215174 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-919548f8-3b31-46e7-a259-563a5b2feec7 req-60a63162-fcc5-41cc-98e7-587ee4ff64f6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032878 Jun 08 14:02:57.215792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 529/1061] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:02:58.118677 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-477b5968-de8c-42d8-925e-1c8b8e78382d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:58.119288 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-477b5968-de8c-42d8-925e-1c8b8e78382d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:58.125901 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-477b5968-de8c-42d8-925e-1c8b8e78382d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:58.126345 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-477b5968-de8c-42d8-925e-1c8b8e78382d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:58.127150 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-477b5968-de8c-42d8-925e-1c8b8e78382d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:58.127590 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-477b5968-de8c-42d8-925e-1c8b8e78382d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:58.262359 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-477b5968-de8c-42d8-925e-1c8b8e78382d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:58.270619 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-477b5968-de8c-42d8-925e-1c8b8e78382d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1267 microversion: 2.1 time: 0.155845 Jun 08 14:02:58.271202 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 533/1062] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:58 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:59.289262 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-45a078b4-4dc4-4646-a10d-9690e2afdf98 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:59.289964 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-45a078b4-4dc4-4646-a10d-9690e2afdf98 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:59.296190 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-45a078b4-4dc4-4646-a10d-9690e2afdf98 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:59.296643 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-45a078b4-4dc4-4646-a10d-9690e2afdf98 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:59.297403 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-45a078b4-4dc4-4646-a10d-9690e2afdf98 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:59.297838 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-45a078b4-4dc4-4646-a10d-9690e2afdf98 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:59.427923 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-45a078b4-4dc4-4646-a10d-9690e2afdf98 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:59.435411 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-45a078b4-4dc4-4646-a10d-9690e2afdf98 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1454 microversion: 2.1 time: 0.150994 Jun 08 14:02:59.435968 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 530/1063] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:59 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:02:59.451300 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-16327072-b614-4b6f-a9b6-99eab03f8c62 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:02:59.451918 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-16327072-b614-4b6f-a9b6-99eab03f8c62 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:02:59.459056 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-16327072-b614-4b6f-a9b6-99eab03f8c62 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:59.459583 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-16327072-b614-4b6f-a9b6-99eab03f8c62 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:59.460452 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-16327072-b614-4b6f-a9b6-99eab03f8c62 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:02:59.461050 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-16327072-b614-4b6f-a9b6-99eab03f8c62 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:02:59.598778 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-16327072-b614-4b6f-a9b6-99eab03f8c62 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:02:59.606529 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-16327072-b614-4b6f-a9b6-99eab03f8c62 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1454 microversion: 2.1 time: 0.159097 Jun 08 14:02:59.607097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 534/1064] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:02:59 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 14:03:01.805686 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-e2c49baf-ab2b-4207-877e-8c1932572bdc req-b21750cd-1113-44f4-9dba-a08fb2e35e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8605b8d6-81fd-4f0b-b353-4a82d040f2dc", "tag": "510c9a79-bb51-4447-a8b8-dec89c386669"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:03:01.814581 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e2c49baf-ab2b-4207-877e-8c1932572bdc req-b21750cd-1113-44f4-9dba-a08fb2e35e85 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:03:01.815038 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e2c49baf-ab2b-4207-877e-8c1932572bdc req-b21750cd-1113-44f4-9dba-a08fb2e35e85 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:03:01.826644 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-e2c49baf-ab2b-4207-877e-8c1932572bdc req-b21750cd-1113-44f4-9dba-a08fb2e35e85 service nova] Creating event network-changed:510c9a79-bb51-4447-a8b8-dec89c386669 for instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc on hv-cinder-81914 Jun 08 14:03:01.832591 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-e2c49baf-ab2b-4207-877e-8c1932572bdc req-b21750cd-1113-44f4-9dba-a08fb2e35e85 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030614 Jun 08 14:03:01.833398 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 531/1065] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:03:20.895178 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:03:20.895856 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Wed Jun 8 14:03:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:03:28.358959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:03:28.359601 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Wed Jun 8 14:03:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:04:52.542965 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:04:52.543793 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:04:52.548507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1314317298", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2047968818", "security_groups": [{"name": "tempest-secgroup-smoke-1337554340"}], "block_device_mapping_v2": [{"uuid": "0ee62ad6-83ef-48b3-bdc2-2746030f9959", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a18d0c8-3777-47d9-8514-f63bd12afcbe"}]}} {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:04:52.664004 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.network.neutron [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] validate_networks() for [('8a18d0c8-3777-47d9-8514-f63bd12afcbe', None, None, None, None, None)] {{(pid=124628) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 08 14:04:53.042571 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Flavor limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 08 14:04:53.043297 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Image limits 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 08 14:04:53.043777 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Flavor pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 08 14:04:53.044213 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Image pref 0:0:0 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 08 14:04:53.044973 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.virt.hardware [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124628) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 08 14:04:53.053290 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:53.053737 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:53.054528 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:53.054994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:53.072172 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Getting quotas for project 935e40a140d74e528002c0bcfd1515aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 08 14:04:53.076863 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.quota [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Getting quotas for user fc41110d12a047f58219b4cf2619f80d and project 935e40a140d74e528002c0bcfd1515aa. Resources: {'ram', 'instances', 'cores'} {{(pid=124628) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 08 14:04:53.134372 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Going to run 1 instances... {{(pid=124628) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 08 14:04:53.136507 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ee62ad6-83ef-48b3-bdc2-2746030f9959',volume_size=None,volume_type=None)] {{(pid=124628) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 08 14:04:53.603959 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-5aa9fe6a-757a-4156-b97d-15713066c317 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.062493 Jun 08 14:04:53.610657 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 535/1066] 10.222.0.55 () {60 vars in 1146 bytes} [Wed Jun 8 14:04:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 08 14:04:53.613982 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR oslo.messaging._drivers.impl_rabbit [-] [926b7fd4-697e-40cf-a5dd-f3352b7913a9] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 08 14:04:53.614579 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:04:53.615356 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=70 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:04:53.620092 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-52b5d0db-6f56-49c4-9136-d6cec2e59253 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:04:53.620843 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-52b5d0db-6f56-49c4-9136-d6cec2e59253 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:04:53.680329 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-52b5d0db-6f56-49c4-9136-d6cec2e59253 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:04:53.687346 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-52b5d0db-6f56-49c4-9136-d6cec2e59253 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1095 microversion: 2.1 time: 0.075195 Jun 08 14:04:53.688090 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 532/1067] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:04:53 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:04:54.705283 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c00e5e26-d41c-44ab-b4c2-7cc16612e1db tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:04:54.705895 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c00e5e26-d41c-44ab-b4c2-7cc16612e1db tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:04:54.712869 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c00e5e26-d41c-44ab-b4c2-7cc16612e1db tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:54.713326 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c00e5e26-d41c-44ab-b4c2-7cc16612e1db tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:54.714097 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c00e5e26-d41c-44ab-b4c2-7cc16612e1db tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:54.714541 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c00e5e26-d41c-44ab-b4c2-7cc16612e1db tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:54.776272 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c00e5e26-d41c-44ab-b4c2-7cc16612e1db tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:04:54.784166 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c00e5e26-d41c-44ab-b4c2-7cc16612e1db tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1145 microversion: 2.1 time: 0.083376 Jun 08 14:04:54.784724 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 536/1068] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:04:54 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:04:55.801446 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e0b48849-10ff-42d6-9ec5-a25902eaaee0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:04:55.802570 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e0b48849-10ff-42d6-9ec5-a25902eaaee0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:04:55.812357 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e0b48849-10ff-42d6-9ec5-a25902eaaee0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:55.813106 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e0b48849-10ff-42d6-9ec5-a25902eaaee0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:55.814060 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e0b48849-10ff-42d6-9ec5-a25902eaaee0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:55.814540 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e0b48849-10ff-42d6-9ec5-a25902eaaee0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:55.848890 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] [926b7fd4-697e-40cf-a5dd-f3352b7913a9] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 51964. Jun 08 14:04:55.885456 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e0b48849-10ff-42d6-9ec5-a25902eaaee0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:04:55.893593 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e0b48849-10ff-42d6-9ec5-a25902eaaee0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1201 microversion: 2.1 time: 0.095992 Jun 08 14:04:55.895235 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 533/1069] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:04:55 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:04:56.912796 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-54e21588-16c2-40ef-a22e-1dff54e4c6c4 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:04:56.913437 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-54e21588-16c2-40ef-a22e-1dff54e4c6c4 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:04:56.921337 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-54e21588-16c2-40ef-a22e-1dff54e4c6c4 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:56.925092 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-54e21588-16c2-40ef-a22e-1dff54e4c6c4 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:56.925092 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-54e21588-16c2-40ef-a22e-1dff54e4c6c4 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:56.925092 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-54e21588-16c2-40ef-a22e-1dff54e4c6c4 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:57.063341 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-54e21588-16c2-40ef-a22e-1dff54e4c6c4 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:04:57.070853 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-54e21588-16c2-40ef-a22e-1dff54e4c6c4 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1279 microversion: 2.1 time: 0.161968 Jun 08 14:04:57.073819 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 537/1070] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:04:56 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:04:57.734672 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-3cf70d9c-e1f9-4d42-9b31-a1b4bde0996f req-eb99a5ec-ad79-468f-94e0-acd5817d496c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6", "tag": "178a3961-9bc2-476d-a90a-f2147a973852"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:04:57.745547 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-3cf70d9c-e1f9-4d42-9b31-a1b4bde0996f req-eb99a5ec-ad79-468f-94e0-acd5817d496c service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:57.745988 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-3cf70d9c-e1f9-4d42-9b31-a1b4bde0996f req-eb99a5ec-ad79-468f-94e0-acd5817d496c service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:57.758285 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-3cf70d9c-e1f9-4d42-9b31-a1b4bde0996f req-eb99a5ec-ad79-468f-94e0-acd5817d496c service nova] Creating event network-changed:178a3961-9bc2-476d-a90a-f2147a973852 for instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 on hv-cinder-81914 Jun 08 14:04:57.763241 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-3cf70d9c-e1f9-4d42-9b31-a1b4bde0996f req-eb99a5ec-ad79-468f-94e0-acd5817d496c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101899 Jun 08 14:04:57.763978 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 534/1071] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:04:58.089126 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-c82b85d7-f971-404f-a685-991da7ce6c93 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:04:58.090372 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-c82b85d7-f971-404f-a685-991da7ce6c93 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:04:58.098022 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c82b85d7-f971-404f-a685-991da7ce6c93 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:58.098435 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c82b85d7-f971-404f-a685-991da7ce6c93 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:58.099208 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c82b85d7-f971-404f-a685-991da7ce6c93 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:58.099651 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-c82b85d7-f971-404f-a685-991da7ce6c93 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:58.236524 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-c82b85d7-f971-404f-a685-991da7ce6c93 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:04:58.244333 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-c82b85d7-f971-404f-a685-991da7ce6c93 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.158938 Jun 08 14:04:58.244897 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 538/1072] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:04:58 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:04:59.262355 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-84da9a8c-5183-4115-8983-7e8afc7fcc51 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:04:59.263698 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-84da9a8c-5183-4115-8983-7e8afc7fcc51 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:04:59.270417 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84da9a8c-5183-4115-8983-7e8afc7fcc51 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:59.270877 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84da9a8c-5183-4115-8983-7e8afc7fcc51 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:59.271647 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84da9a8c-5183-4115-8983-7e8afc7fcc51 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:04:59.272121 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-84da9a8c-5183-4115-8983-7e8afc7fcc51 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:04:59.404630 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-84da9a8c-5183-4115-8983-7e8afc7fcc51 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:04:59.412233 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-84da9a8c-5183-4115-8983-7e8afc7fcc51 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.154472 Jun 08 14:04:59.412963 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 535/1073] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:04:59 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 14:05:00.429417 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-7170071d-1be3-441c-af60-0eed70a278a2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:00.429960 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-7170071d-1be3-441c-af60-0eed70a278a2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:00.437197 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7170071d-1be3-441c-af60-0eed70a278a2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:00.437654 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7170071d-1be3-441c-af60-0eed70a278a2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:00.438429 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7170071d-1be3-441c-af60-0eed70a278a2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:00.438871 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-7170071d-1be3-441c-af60-0eed70a278a2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:00.567069 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-7170071d-1be3-441c-af60-0eed70a278a2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:00.574438 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-7170071d-1be3-441c-af60-0eed70a278a2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.149011 Jun 08 14:05:00.574994 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 539/1074] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:00 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:01.638710 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-e241900e-16a7-4d2b-acd5-d374fa72be40 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:01.639400 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-e241900e-16a7-4d2b-acd5-d374fa72be40 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:01.645344 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e241900e-16a7-4d2b-acd5-d374fa72be40 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:01.645792 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e241900e-16a7-4d2b-acd5-d374fa72be40 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:01.646548 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e241900e-16a7-4d2b-acd5-d374fa72be40 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:01.646981 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-e241900e-16a7-4d2b-acd5-d374fa72be40 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:01.776869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-e241900e-16a7-4d2b-acd5-d374fa72be40 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:01.785124 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-e241900e-16a7-4d2b-acd5-d374fa72be40 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.197448 Jun 08 14:05:01.785692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 536/1075] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:01 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:02.801787 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-e38bb1b5-d5ec-40d1-a5f5-082ec5055c55 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:02.802403 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-e38bb1b5-d5ec-40d1-a5f5-082ec5055c55 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:02.808942 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e38bb1b5-d5ec-40d1-a5f5-082ec5055c55 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:02.809393 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e38bb1b5-d5ec-40d1-a5f5-082ec5055c55 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:02.810271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e38bb1b5-d5ec-40d1-a5f5-082ec5055c55 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:02.810738 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-e38bb1b5-d5ec-40d1-a5f5-082ec5055c55 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:02.946249 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-e38bb1b5-d5ec-40d1-a5f5-082ec5055c55 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:02.954002 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-e38bb1b5-d5ec-40d1-a5f5-082ec5055c55 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.156065 Jun 08 14:05:02.954570 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 540/1076] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:02 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:03.970956 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d8cc9dae-209a-4520-bac0-ac53f99551a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:03.971497 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d8cc9dae-209a-4520-bac0-ac53f99551a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:03.973991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell0:SELECT=2 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:05:03.978833 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d8cc9dae-209a-4520-bac0-ac53f99551a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:03.985823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d8cc9dae-209a-4520-bac0-ac53f99551a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:03.985823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d8cc9dae-209a-4520-bac0-ac53f99551a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:03.985823 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d8cc9dae-209a-4520-bac0-ac53f99551a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:04.120062 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d8cc9dae-209a-4520-bac0-ac53f99551a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:04.128508 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d8cc9dae-209a-4520-bac0-ac53f99551a9 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.161453 Jun 08 14:05:04.129083 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 537/1077] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:03 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:05.145087 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-fd7b4525-860c-48d3-beb3-99ceb5ba4f8d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:05.145746 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-fd7b4525-860c-48d3-beb3-99ceb5ba4f8d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:05.147711 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=2 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:05:05.148773 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell0:SELECT=6 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:05:05.154047 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fd7b4525-860c-48d3-beb3-99ceb5ba4f8d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:05.160891 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fd7b4525-860c-48d3-beb3-99ceb5ba4f8d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:05.160891 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fd7b4525-860c-48d3-beb3-99ceb5ba4f8d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:05.160891 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-fd7b4525-860c-48d3-beb3-99ceb5ba4f8d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:05.289609 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-fd7b4525-860c-48d3-beb3-99ceb5ba4f8d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:05.297791 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-fd7b4525-860c-48d3-beb3-99ceb5ba4f8d tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.156558 Jun 08 14:05:05.298353 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 541/1078] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:05 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:06.315531 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-c4e45a11-674a-4f06-a5c7-c661542e8bca tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:06.316198 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-c4e45a11-674a-4f06-a5c7-c661542e8bca tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:06.322721 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c4e45a11-674a-4f06-a5c7-c661542e8bca tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:06.323168 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c4e45a11-674a-4f06-a5c7-c661542e8bca tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:06.323924 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c4e45a11-674a-4f06-a5c7-c661542e8bca tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:06.324386 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-c4e45a11-674a-4f06-a5c7-c661542e8bca tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:06.454780 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-c4e45a11-674a-4f06-a5c7-c661542e8bca tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:06.462226 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-c4e45a11-674a-4f06-a5c7-c661542e8bca tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.151142 Jun 08 14:05:06.462788 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 538/1079] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:06 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:07.478631 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-1431e0f9-1ae9-4ce4-82e3-527b99875bc6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:07.479279 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-1431e0f9-1ae9-4ce4-82e3-527b99875bc6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:07.486749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1431e0f9-1ae9-4ce4-82e3-527b99875bc6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:07.487243 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1431e0f9-1ae9-4ce4-82e3-527b99875bc6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:07.488017 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1431e0f9-1ae9-4ce4-82e3-527b99875bc6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:07.488497 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-1431e0f9-1ae9-4ce4-82e3-527b99875bc6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:07.615847 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-1431e0f9-1ae9-4ce4-82e3-527b99875bc6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:07.623287 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-1431e0f9-1ae9-4ce4-82e3-527b99875bc6 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.148698 Jun 08 14:05:07.623853 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 542/1080] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:07 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:07.918501 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-4bee2790-b98b-4c2e-ba5a-465f315e2799 req-b6833b6e-296b-4406-bea8-67923359470b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6", "name": "network-vif-plugged", "status": "completed", "tag": "178a3961-9bc2-476d-a90a-f2147a973852"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:05:07.926579 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-4bee2790-b98b-4c2e-ba5a-465f315e2799 req-b6833b6e-296b-4406-bea8-67923359470b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:07.927036 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-4bee2790-b98b-4c2e-ba5a-465f315e2799 req-b6833b6e-296b-4406-bea8-67923359470b service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:07.938570 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-4bee2790-b98b-4c2e-ba5a-465f315e2799 req-b6833b6e-296b-4406-bea8-67923359470b service nova] Creating event network-vif-plugged:178a3961-9bc2-476d-a90a-f2147a973852 for instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 on hv-cinder-81914 Jun 08 14:05:07.943563 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-4bee2790-b98b-4c2e-ba5a-465f315e2799 req-b6833b6e-296b-4406-bea8-67923359470b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082382 Jun 08 14:05:07.944158 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 539/1081] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:05:08.640358 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-2eb80fd3-60f7-422f-a61a-45f2569ec7f2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:08.640970 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-2eb80fd3-60f7-422f-a61a-45f2569ec7f2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:08.647512 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2eb80fd3-60f7-422f-a61a-45f2569ec7f2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:08.647972 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2eb80fd3-60f7-422f-a61a-45f2569ec7f2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:08.648772 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2eb80fd3-60f7-422f-a61a-45f2569ec7f2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:08.649220 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-2eb80fd3-60f7-422f-a61a-45f2569ec7f2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:08.785139 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-2eb80fd3-60f7-422f-a61a-45f2569ec7f2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:08.792788 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-2eb80fd3-60f7-422f-a61a-45f2569ec7f2 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1267 microversion: 2.1 time: 0.156434 Jun 08 14:05:08.793326 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 543/1082] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:08 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:09.810374 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-d1d97301-8f2e-438a-a61d-be11b410796a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:09.811086 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-d1d97301-8f2e-438a-a61d-be11b410796a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:09.817379 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d1d97301-8f2e-438a-a61d-be11b410796a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:09.817846 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d1d97301-8f2e-438a-a61d-be11b410796a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:09.818615 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d1d97301-8f2e-438a-a61d-be11b410796a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:09.819056 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-d1d97301-8f2e-438a-a61d-be11b410796a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:09.949910 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-d1d97301-8f2e-438a-a61d-be11b410796a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:09.958353 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-d1d97301-8f2e-438a-a61d-be11b410796a tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1454 microversion: 2.1 time: 0.152824 Jun 08 14:05:09.958917 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 540/1083] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:09 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:09.975169 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d21fce98-6df5-45cc-99cc-7fdd24f07853 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:05:09.975785 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d21fce98-6df5-45cc-99cc-7fdd24f07853 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:05:09.982493 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d21fce98-6df5-45cc-99cc-7fdd24f07853 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:09.982938 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d21fce98-6df5-45cc-99cc-7fdd24f07853 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:09.983695 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d21fce98-6df5-45cc-99cc-7fdd24f07853 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:09.984189 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d21fce98-6df5-45cc-99cc-7fdd24f07853 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:10.117908 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d21fce98-6df5-45cc-99cc-7fdd24f07853 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:05:10.125453 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d21fce98-6df5-45cc-99cc-7fdd24f07853 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1454 microversion: 2.1 time: 0.154167 Jun 08 14:05:10.126012 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 544/1084] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:05:09 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:05:12.045016 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-00d54a95-3410-4b8a-9325-84cba2ab77d6 req-decb158c-d19c-4083-95cc-f0b27ba52d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6", "tag": "178a3961-9bc2-476d-a90a-f2147a973852"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:05:12.053418 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-00d54a95-3410-4b8a-9325-84cba2ab77d6 req-decb158c-d19c-4083-95cc-f0b27ba52d32 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:05:12.053869 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-00d54a95-3410-4b8a-9325-84cba2ab77d6 req-decb158c-d19c-4083-95cc-f0b27ba52d32 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:05:12.065498 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-00d54a95-3410-4b8a-9325-84cba2ab77d6 req-decb158c-d19c-4083-95cc-f0b27ba52d32 service nova] Creating event network-changed:178a3961-9bc2-476d-a90a-f2147a973852 for instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 on hv-cinder-81914 Jun 08 14:05:12.071038 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-00d54a95-3410-4b8a-9325-84cba2ab77d6 req-decb158c-d19c-4083-95cc-f0b27ba52d32 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030008 Jun 08 14:05:12.071642 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 541/1085] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:05:24.776564 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:05:24.777341 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Wed Jun 8 14:05:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:05:37.108470 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:05:37.109024 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Wed Jun 8 14:05:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:06:06.140549 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:06:06.141072 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Wed Jun 8 14:06:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:06:42.418077 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-bf165ec0-ba19-4385-83c8-3b56dde5f1fe tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:42.418654 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bf165ec0-ba19-4385-83c8-3b56dde5f1fe tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:42.423278 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_api:SELECT=22 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:06:42.424573 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG dbcounter [-] [124629] Writing DB stats nova_cell1:SELECT=42 {{(pid=124629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:06:42.428849 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-860f533e-2bac-455e-aeda-25f6737f0f19 req-074f4d22-a9db-43ea-acde-f0a5c7ee58f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6", "tag": "178a3961-9bc2-476d-a90a-f2147a973852"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:06:42.433101 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:06:42.438238 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG dbcounter [-] [124628] Writing DB stats nova_cell1:SELECT=56 {{(pid=124628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 08 14:06:42.439580 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf165ec0-ba19-4385-83c8-3b56dde5f1fe tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:42.440252 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf165ec0-ba19-4385-83c8-3b56dde5f1fe tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:42.441041 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf165ec0-ba19-4385-83c8-3b56dde5f1fe tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:42.441160 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-860f533e-2bac-455e-aeda-25f6737f0f19 req-074f4d22-a9db-43ea-acde-f0a5c7ee58f7 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:42.441482 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-bf165ec0-ba19-4385-83c8-3b56dde5f1fe tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:42.441601 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-860f533e-2bac-455e-aeda-25f6737f0f19 req-074f4d22-a9db-43ea-acde-f0a5c7ee58f7 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:42.453027 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-860f533e-2bac-455e-aeda-25f6737f0f19 req-074f4d22-a9db-43ea-acde-f0a5c7ee58f7 service nova] Creating event network-changed:178a3961-9bc2-476d-a90a-f2147a973852 for instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 on hv-cinder-81914 Jun 08 14:06:42.458527 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-860f533e-2bac-455e-aeda-25f6737f0f19 req-074f4d22-a9db-43ea-acde-f0a5c7ee58f7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036926 Jun 08 14:06:42.459503 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 542/1086] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:06:42.472529 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-bf165ec0-ba19-4385-83c8-3b56dde5f1fe tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Going to try to terminate instance {{(pid=124628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 14:06:42.849720 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-bf165ec0-ba19-4385-83c8-3b56dde5f1fe tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 204 len: 0 microversion: 2.1 time: 0.435807 Jun 08 14:06:42.853359 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 545/1087] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 14:06:42 2022] DELETE /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 14:06:42.862146 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-94485889-bcd8-4ebd-a999-512be858ed66 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:42.862843 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-94485889-bcd8-4ebd-a999-512be858ed66 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:42.870064 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-94485889-bcd8-4ebd-a999-512be858ed66 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:42.870513 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-94485889-bcd8-4ebd-a999-512be858ed66 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:42.871430 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-94485889-bcd8-4ebd-a999-512be858ed66 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:42.872082 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-94485889-bcd8-4ebd-a999-512be858ed66 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:43.005323 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-94485889-bcd8-4ebd-a999-512be858ed66 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:06:43.013438 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-94485889-bcd8-4ebd-a999-512be858ed66 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1579 microversion: 2.1 time: 0.157055 Jun 08 14:06:43.014658 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 543/1088] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:06:42 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 08 14:06:44.031549 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-565b2f04-5cab-41ea-9b46-f11606484a48 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:44.032200 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-565b2f04-5cab-41ea-9b46-f11606484a48 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:44.038186 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-565b2f04-5cab-41ea-9b46-f11606484a48 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:44.038640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-565b2f04-5cab-41ea-9b46-f11606484a48 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:44.039405 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-565b2f04-5cab-41ea-9b46-f11606484a48 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:44.039875 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-565b2f04-5cab-41ea-9b46-f11606484a48 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:44.182402 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-565b2f04-5cab-41ea-9b46-f11606484a48 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:06:44.190334 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-565b2f04-5cab-41ea-9b46-f11606484a48 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1460 microversion: 2.1 time: 0.164165 Jun 08 14:06:44.190920 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 546/1089] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:06:44 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1460 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:06:44.810875 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-06ef88c6-3bb8-4abb-9f56-0132cd32ffff req-61808a56-c6ed-49f6-b2fb-89c482452569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6", "name": "network-vif-deleted", "tag": "178a3961-9bc2-476d-a90a-f2147a973852"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:06:44.819511 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-06ef88c6-3bb8-4abb-9f56-0132cd32ffff req-61808a56-c6ed-49f6-b2fb-89c482452569 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:44.819960 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-06ef88c6-3bb8-4abb-9f56-0132cd32ffff req-61808a56-c6ed-49f6-b2fb-89c482452569 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:44.832078 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-06ef88c6-3bb8-4abb-9f56-0132cd32ffff req-61808a56-c6ed-49f6-b2fb-89c482452569 service nova] Creating event network-vif-deleted:178a3961-9bc2-476d-a90a-f2147a973852 for instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 on hv-cinder-81914 Jun 08 14:06:44.836849 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-06ef88c6-3bb8-4abb-9f56-0132cd32ffff req-61808a56-c6ed-49f6-b2fb-89c482452569 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030433 Jun 08 14:06:44.837424 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 544/1090] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:06:45.207045 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-d7a37ba4-9700-4058-be66-1adb5489d1c3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:45.207666 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-d7a37ba4-9700-4058-be66-1adb5489d1c3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:45.214871 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d7a37ba4-9700-4058-be66-1adb5489d1c3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:45.215331 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d7a37ba4-9700-4058-be66-1adb5489d1c3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:45.216203 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d7a37ba4-9700-4058-be66-1adb5489d1c3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:45.216647 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-d7a37ba4-9700-4058-be66-1adb5489d1c3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:45.285048 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-d7a37ba4-9700-4058-be66-1adb5489d1c3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:06:45.293412 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-d7a37ba4-9700-4058-be66-1adb5489d1c3 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 200 len: 1226 microversion: 2.1 time: 0.090272 Jun 08 14:06:45.293985 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 547/1091] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:06:45 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:06:46.311877 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:46.312987 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:46.319862 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:46.320344 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:46.321113 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:46.321552 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:46.334684 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] HTTP exception thrown: Instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 could not be found. Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Request method failure captured: Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 HTTP/1.1 Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKtar-qaDqzNowsQnaGaOCJu8uDVUTtWJNxs253Jx-yv-O5TsA-fTEXp8QM_7CeO2OnQnUFuBHO0eAY0Na6p1OvqpomIBGZ0iy-erVRZa9WrAhMLCPatqSWGWVumT72g2QCX8JPpeuM50ryqLIeRaq1L7MuoSwYyJfNsQIPJp2jv4Lw Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 14:06:46.336314 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_935e40a140d74e528002c0bcfd1515aa", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}] Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: fc41110d12a047f58219b4cf2619f80d Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 could not be found. Jun 08 14:06:46.338275 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6'} Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 could not be found. Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 14:06:46.340399 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 could not be found. Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 could not be found. Jun 08 14:06:46.342263 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:46.343777 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Returning 404 to user: Instance 4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 14:06:46.343777 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-0aecbbca-a475-4b3e-9324-7e8af980bc6f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6" status: 404 len: 111 microversion: 2.1 time: 0.031789 Jun 08 14:06:46.343777 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 545/1092] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:06:46 2022] GET /compute/v2.1/servers/4eaa9552-20a9-48f5-b9c4-8e2ea23fabe6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 14:06:48.368852 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:06:48.370199 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Wed Jun 8 14:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:06:49.702950 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-f23f4a59-3b31-4c4a-8bdb-ca6ef1dc3e3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:49.703607 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f23f4a59-3b31-4c4a-8bdb-ca6ef1dc3e3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:49.704438 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-14df4a26-5235-44c6-a4cd-8c81ed7e6b2d req-a390cfae-e4e1-493a-aac3-3a17e94cca2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8605b8d6-81fd-4f0b-b353-4a82d040f2dc", "tag": "510c9a79-bb51-4447-a8b8-dec89c386669"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:06:49.711115 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f23f4a59-3b31-4c4a-8bdb-ca6ef1dc3e3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:49.711680 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f23f4a59-3b31-4c4a-8bdb-ca6ef1dc3e3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:49.712753 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f23f4a59-3b31-4c4a-8bdb-ca6ef1dc3e3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:49.713303 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-f23f4a59-3b31-4c4a-8bdb-ca6ef1dc3e3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:49.713756 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-14df4a26-5235-44c6-a4cd-8c81ed7e6b2d req-a390cfae-e4e1-493a-aac3-3a17e94cca2c service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:49.714248 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-14df4a26-5235-44c6-a4cd-8c81ed7e6b2d req-a390cfae-e4e1-493a-aac3-3a17e94cca2c service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:49.726963 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-14df4a26-5235-44c6-a4cd-8c81ed7e6b2d req-a390cfae-e4e1-493a-aac3-3a17e94cca2c service nova] Creating event network-changed:510c9a79-bb51-4447-a8b8-dec89c386669 for instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc on hv-cinder-81914 Jun 08 14:06:49.734539 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-14df4a26-5235-44c6-a4cd-8c81ed7e6b2d req-a390cfae-e4e1-493a-aac3-3a17e94cca2c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033865 Jun 08 14:06:49.735676 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 546/1093] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:06:49.744436 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-f23f4a59-3b31-4c4a-8bdb-ca6ef1dc3e3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Going to try to terminate instance {{(pid=124628) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 08 14:06:50.074316 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-f23f4a59-3b31-4c4a-8bdb-ca6ef1dc3e3f tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 204 len: 0 microversion: 2.1 time: 0.375657 Jun 08 14:06:50.078140 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 548/1094] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 14:06:49 2022] DELETE /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 08 14:06:50.083835 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-795cc4f6-4a2b-4213-9220-2b45eb6d17ed tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:50.084604 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-795cc4f6-4a2b-4213-9220-2b45eb6d17ed tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:50.091839 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-795cc4f6-4a2b-4213-9220-2b45eb6d17ed tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:50.092138 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-795cc4f6-4a2b-4213-9220-2b45eb6d17ed tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:50.093222 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-795cc4f6-4a2b-4213-9220-2b45eb6d17ed tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:50.093898 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-795cc4f6-4a2b-4213-9220-2b45eb6d17ed tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:50.236936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.policy [None req-795cc4f6-4a2b-4213-9220-2b45eb6d17ed tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:06:50.244936 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-795cc4f6-4a2b-4213-9220-2b45eb6d17ed tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1579 microversion: 2.1 time: 0.165294 Jun 08 14:06:50.246134 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 547/1095] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:06:50 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:06:51.264785 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-20921b8c-d052-4ae8-90ee-f1455585a096 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:51.265493 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-20921b8c-d052-4ae8-90ee-f1455585a096 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:51.271929 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20921b8c-d052-4ae8-90ee-f1455585a096 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:51.272419 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20921b8c-d052-4ae8-90ee-f1455585a096 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:51.273194 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20921b8c-d052-4ae8-90ee-f1455585a096 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:51.273640 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-20921b8c-d052-4ae8-90ee-f1455585a096 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:51.405395 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-20921b8c-d052-4ae8-90ee-f1455585a096 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:06:51.412853 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-20921b8c-d052-4ae8-90ee-f1455585a096 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1460 microversion: 2.1 time: 0.153074 Jun 08 14:06:51.413414 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 549/1096] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:06:51 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1460 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:06:52.000173 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [req-e1ab55aa-617e-4cd7-b57f-5634503c75e9 req-bb21b07b-296e-4ca0-8650-5ffb79710078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8605b8d6-81fd-4f0b-b353-4a82d040f2dc", "name": "network-vif-deleted", "tag": "510c9a79-bb51-4447-a8b8-dec89c386669"}]} {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 08 14:06:52.008709 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e1ab55aa-617e-4cd7-b57f-5634503c75e9 req-bb21b07b-296e-4ca0-8650-5ffb79710078 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:52.009153 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [req-e1ab55aa-617e-4cd7-b57f-5634503c75e9 req-bb21b07b-296e-4ca0-8650-5ffb79710078 service nova] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:52.020517 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.compute.server_external_events [req-e1ab55aa-617e-4cd7-b57f-5634503c75e9 req-bb21b07b-296e-4ca0-8650-5ffb79710078 service nova] Creating event network-vif-deleted:510c9a79-bb51-4447-a8b8-dec89c386669 for instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc on hv-cinder-81914 Jun 08 14:06:52.025455 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [req-e1ab55aa-617e-4cd7-b57f-5634503c75e9 req-bb21b07b-296e-4ca0-8650-5ffb79710078 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029038 Jun 08 14:06:52.026032 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 548/1097] 10.222.0.55 () {64 vars in 1317 bytes} [Wed Jun 8 14:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 08 14:06:52.430133 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-11cfa4d5-ff4f-478a-a4fe-bb13726545a0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:52.430862 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-11cfa4d5-ff4f-478a-a4fe-bb13726545a0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:52.438126 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11cfa4d5-ff4f-478a-a4fe-bb13726545a0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:52.438582 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11cfa4d5-ff4f-478a-a4fe-bb13726545a0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:52.439348 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11cfa4d5-ff4f-478a-a4fe-bb13726545a0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:52.439813 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-11cfa4d5-ff4f-478a-a4fe-bb13726545a0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:52.739349 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.policy [None req-11cfa4d5-ff4f-478a-a4fe-bb13726545a0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41110d12a047f58219b4cf2619f80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '935e40a140d74e528002c0bcfd1515aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124628) authorize /opt/stack/nova/nova/policy.py:199}} Jun 08 14:06:52.747842 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-11cfa4d5-ff4f-478a-a4fe-bb13726545a0 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 200 len: 1226 microversion: 2.1 time: 0.321069 Jun 08 14:06:52.748476 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 550/1098] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:06:52 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 1226 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 08 14:06:53.766464 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:53.767184 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 8605b8d6-81fd-4f0b-b353-4a82d040f2dc] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:53.773486 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:53.773944 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:53.774713 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:53.775157 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:53.788280 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] HTTP exception thrown: Instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc could not be found. Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Request method failure captured: Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc HTTP/1.1 Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKtar-qaDqzNowsQnaGaOCJu8uDVUTtWJNxs253Jx-yv-O5TsA-fTEXp8QM_7CeO2OnQnUFuBHO0eAY0Na6p1OvqpomIBGZ0iy-erVRZa9WrAhMLCPatqSWGWVumT72g2QCX8JPpeuM50ryqLIeRaq1L7MuoSwYyJfNsQIPJp2jv4Lw Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 14:06:53.789873 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_935e40a140d74e528002c0bcfd1515aa", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}] Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: fc41110d12a047f58219b4cf2619f80d Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc could not be found. Jun 08 14:06:53.791611 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '8605b8d6-81fd-4f0b-b353-4a82d040f2dc'} Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc could not be found. Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 14:06:53.792692 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc could not be found. Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc could not be found. Jun 08 14:06:53.794410 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:53.795941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Returning 404 to user: Instance 8605b8d6-81fd-4f0b-b353-4a82d040f2dc could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 14:06:53.795941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-dbd06ee3-c396-4494-b741-d7447fffd4ae tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc" status: 404 len: 111 microversion: 2.1 time: 0.030445 Jun 08 14:06:53.795941 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 549/1099] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:06:53 2022] GET /compute/v2.1/servers/8605b8d6-81fd-4f0b-b353-4a82d040f2dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 14:06:54.314323 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:54.314861 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.compute.api [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124628) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:54.321543 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:54.322321 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:54.322799 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:54.323233 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG oslo_concurrency.lockutils [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:54.337387 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.wsgi [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] HTTP exception thrown: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Request method failure captured: Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: request: DELETE /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 HTTP/1.1 Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept: application/json Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Accept-Encoding: identity Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Connection: close Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Length: 0 Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Content-Type: application/json Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Host: 10.222.0.55 Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Openstack-System-Scope: None Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: User-Agent: python-urllib3/1.26.9 Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Auth-Token: gAAAAABioKtar-qaDqzNowsQnaGaOCJu8uDVUTtWJNxs253Jx-yv-O5TsA-fTEXp8QM_7CeO2OnQnUFuBHO0eAY0Na6p1OvqpomIBGZ0iy-erVRZa9WrAhMLCPatqSWGWVumT72g2QCX8JPpeuM50ryqLIeRaq1L7MuoSwYyJfNsQIPJp2jv4Lw Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Id: None Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Domain-Name: None Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Identity-Status: Confirmed Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Is-Admin-Project: True Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Id: default Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Domain-Name: Default Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Project-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Role: member,reader Jun 08 14:06:54.339109 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Roles: member,reader Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_935e40a140d74e528002c0bcfd1515aa", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}] Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-Tenant-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Id: default Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Domain-Name: Default Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Id: fc41110d12a047f58219b4cf2619f80d Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: X-User-Name: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: method: > Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: exception: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.341615 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: action_args: {'id': '7d3f14a4-b72e-4500-b1bd-2dca9d571995'} Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 14:06:54.345749 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.351523 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.353271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Returning 404 to user: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. {{(pid=124628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 14:06:54.353271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-63eabc17-ed0a-4946-9573-23628b418afd tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "DELETE /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 404 len: 111 microversion: 2.1 time: 0.031687 Jun 08 14:06:54.353271 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 551/1100] 10.222.0.55 () {58 vars in 1238 bytes} [Wed Jun 8 14:06:54 2022] DELETE /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 08 14:06:54.353636 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '>' {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:54.353636 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.compute.api [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] [instance: 7d3f14a4-b72e-4500-b1bd-2dca9d571995] Fetching instance by UUID {{(pid=124629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 08 14:06:54.357768 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:54.358217 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:54.358981 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 08 14:06:54.359420 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG oslo_concurrency.lockutils [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Lock "e34c71c5-8d83-411d-9d43-2dd085938513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 08 14:06:54.373052 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.wsgi [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] HTTP exception thrown: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Request method failure captured: Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: request: GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 HTTP/1.1 Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept: application/json Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Accept-Encoding: identity Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Connection: close Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Length: 0 Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Content-Type: application/json Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Host: 10.222.0.55 Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Openstack-System-Scope: None Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: User-Agent: python-urllib3/1.26.9 Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Auth-Token: gAAAAABioKtar-qaDqzNowsQnaGaOCJu8uDVUTtWJNxs253Jx-yv-O5TsA-fTEXp8QM_7CeO2OnQnUFuBHO0eAY0Na6p1OvqpomIBGZ0iy-erVRZa9WrAhMLCPatqSWGWVumT72g2QCX8JPpeuM50ryqLIeRaq1L7MuoSwYyJfNsQIPJp2jv4Lw Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Id: None Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Domain-Name: None Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Identity-Status: Confirmed Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Is-Admin-Project: True Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Id: default Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Domain-Name: Default Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Project-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Role: member,reader Jun 08 14:06:54.374618 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Roles: member,reader Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_935e40a140d74e528002c0bcfd1515aa", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/935e40a140d74e528002c0bcfd1515aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/935e40a140d74e528002c0bcfd1515aa"}]}] Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Id: 935e40a140d74e528002c0bcfd1515aa Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-Tenant-Name: tempest-TestVolumeBootPattern-704636513 Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Id: default Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Domain-Name: Default Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Id: fc41110d12a047f58219b4cf2619f80d Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: X-User-Name: tempest-TestVolumeBootPattern-704636513-project Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: method: > Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: exception: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.376309 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: action_args: {'id': '7d3f14a4-b72e-4500-b1bd-2dca9d571995'} Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: {{(pid=124629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 08 14:06:54.377300 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. Jun 08 14:06:54.378903 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: ERROR nova.api.openstack.wsgi Jun 08 14:06:54.380242 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: DEBUG nova.api.openstack.wsgi [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Returning 404 to user: Instance 7d3f14a4-b72e-4500-b1bd-2dca9d571995 could not be found. {{(pid=124629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 08 14:06:54.380242 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO nova.api.openstack.requestlog [None req-1aa88d32-d6b1-43c4-92cf-139821c58401 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995" status: 404 len: 111 microversion: 2.1 time: 0.029814 Jun 08 14:06:54.380242 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: [pid: 124629|app: 0|req: 550/1101] 10.222.0.55 () {58 vars in 1235 bytes} [Wed Jun 8 14:06:54 2022] GET /compute/v2.1/servers/7d3f14a4-b72e-4500-b1bd-2dca9d571995 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 08 14:06:55.912748 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: DEBUG nova.api.openstack.wsgi [None req-45ba06b9-a697-4b58-816f-a711f8431d80 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] Calling method '.version_select at 0x7fe289499e50>' {{(pid=124628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 08 14:06:55.988625 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO nova.api.openstack.requestlog [None req-45ba06b9-a697-4b58-816f-a711f8431d80 tempest-TestVolumeBootPattern-704636513 tempest-TestVolumeBootPattern-704636513-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2047968818" status: 202 len: 0 microversion: 2.1 time: 0.079659 Jun 08 14:06:55.989212 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: [pid: 124628|app: 0|req: 552/1102] 10.222.0.55 () {58 vars in 1262 bytes} [Wed Jun 8 14:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2047968818 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 08 14:08:44.785514 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:08:44.786129 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Wed Jun 8 14:08:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:09:26.149991 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:09:26.150599 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Wed Jun 8 14:09:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:10:00.908390 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:10:00.908928 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Wed Jun 8 14:10:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:10:08.378384 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:10:08.378984 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Wed Jun 8 14:10:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:11:57.412487 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:11:57.413266 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Wed Jun 8 14:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:12:04.793965 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:12:04.794648 dv-cinder-819149-5-iscsi devstack@n-api.service[124629]: Wed Jun 8 14:12:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 08 14:12:17.120518 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 08 14:12:17.121055 dv-cinder-819149-5-iscsi devstack@n-api.service[124628]: Wed Jun 8 14:12:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!